Feb 28 01:16:26 devstack cinder-volume[72656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 01:16:26 devstack cinder-volume[72656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 01:16:26 devstack cinder-volume[72656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 01:16:26 devstack cinder-volume[72656]: INFO dbcounter [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Registered counter for database cinder
Feb 28 01:16:26 devstack cinder-volume[72656]: DEBUG oslo_db.sqlalchemy.engines [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:16:26 devstack cinder-volume[72656]: DEBUG dbcounter [-] [72656] Writer thread running {{(pid=72656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 01:16:26 devstack cinder-volume[72656]: INFO cinder.rpc [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 28 01:16:26 devstack cinder-volume[72656]: INFO cinder.rpc [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 28 01:16:26 devstack cinder-volume[72656]: DEBUG oslo_db.sqlalchemy.engines [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:16:26 devstack cinder-volume[72656]: INFO cinder.volume.manager [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Determined volume DB was empty at startup.
Feb 28 01:16:26 devstack cinder-volume[72656]: DEBUG cinder.volume.manager [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72656) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 28 01:16:26 devstack cinder-volume[72656]: INFO cinder.volume.manager [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Service not found for updating active_backend_id, assuming default for driver init.
Feb 28 01:16:26 devstack cinder-volume[72656]: WARNING stevedore.named [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 28 01:16:26 devstack cinder-volume[72656]: WARNING castellan.key_manager [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 01:16:26 devstack cinder-volume[72656]: WARNING cinder.keymgr.conf_key_mgr [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 01:16:26 devstack cinder-volume[72656]: DEBUG cinder.volume.drivers.lvm [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72656) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Feb 28 01:16:26 devstack cinder-volume[72656]: DEBUG oslo_concurrency.processutils [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_concurrency.processutils [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] CMD "cinder-rtstool verify" returned: 0 in 0.244s {{(pid=72656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_db.sqlalchemy.engines [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:16:27 devstack cinder-volume[72656]: INFO cinder.rpc [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Feb 28 01:16:27 devstack cinder-volume[72656]: INFO cinder.rpc [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Feb 28 01:16:27 devstack cinder-volume[72656]: WARNING stevedore.named [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 28 01:16:27 devstack cinder-volume[72656]: WARNING castellan.key_manager [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 01:16:27 devstack cinder-volume[72656]: INFO cinder.volume.manager [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_db.sqlalchemy.engines [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:16:27 devstack cinder-volume[72656]: INFO oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Starting 1 workers
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Started child 72756 {{(pid=72656) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Full set of CONF: {{(pid=72656) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] ******************************************************************************** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Configuration options gathered from: {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] ================================================================================ {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] allow_availability_zone_fallback = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72756]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] allow_compression_on_image_upload = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] allowed_direct_url_schemes     = [] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] api_rate_limit                 = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] auth_strategy                  = keystone {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] az_cache_duration              = 3600 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_availability_zone      = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_host                   = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_name                   = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_stats_polling_interval = 60 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backup_api_class               = cinder.backup.api.API {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backup_name_template           = backup-%s {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backup_use_same_host           = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backup_use_temp_snapshot       = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] chap_password                  = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] chap_username                  =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cinder_internal_tenant_project_id = bf6c0c6fa1eb49d7aaacd98237bf7cac {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cinder_internal_tenant_user_id = 95d2b1be107648fc8078507325220906 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cloned_volume_same_az          = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cluster                        = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] compression_format             = gzip {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] compute_api_class              = cinder.compute.nova.API {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] config_dir                     = [] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] config_source                  = [] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] control_exchange               = openstack {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] debug                          = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] default_availability_zone      = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] default_group_type             = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] default_volume_type            = lvmdriver-1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] disk_geometry                  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] driver_client_cert             = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] driver_client_cert_key         = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] driver_data_namespace          = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] driver_ssl_cert_path           = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] driver_ssl_cert_verify         = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] driver_use_ssl                 = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] enable_force_upload            = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] enable_new_services            = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] enable_unsupported_driver      = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72756]: INFO cinder.volume.manager [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] enforce_multipath_for_image_xfer = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] filter_function                = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance_api_insecure            = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance_api_servers             = ['http://192.168.122.50/image'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance_api_ssl_compression     = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance_ca_certificates_file    = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance_catalog_info            = image:glance:publicURL {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance_certfile                = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance_keyfile                 = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance_num_retries             = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance_request_timeout         = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] goodness_function              = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] graceful_shutdown_timeout      = 5 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] group_api_class                = cinder.group.api.API {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] host                           = devstack {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] image_compress_on_upload       = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] image_conversion_address_space_limit = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] image_conversion_cpu_limit     = 60 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] image_conversion_disable       = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] image_upload_use_cinder_backend = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] image_upload_use_internal_tenant = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] image_volume_cache_enabled     = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] image_volume_cache_max_count   = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] image_volume_cache_max_size_gb = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] init_host_max_objects_retrieval = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] instance_format                = [instance: %(uuid)s]  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] iscsi_target_flags             =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] iscsi_write_cache              = on {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] iser_helper                    = tgtadm {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] iser_ip_address                = 192.168.122.50 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] iser_port                      = 3260 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] log_color                      = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] log_config_append              = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] log_dir                        = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] log_file                       = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] log_options                    = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] log_rotate_interval            = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] log_rotate_interval_type       = days {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] log_rotation_type              = none {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] max_age                        = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] max_logfile_count              = 30 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] max_logfile_size_mb            = 200 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] max_over_subscription_ratio    = 20.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] message_reap_interval          = 86400 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] message_ttl                    = 2592000 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] migration_create_volume_timeout_secs = 300 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] monkey_patch                   = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] monkey_patch_modules           = [] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] my_ip                          = 192.168.122.50 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] no_snapshot_gb_quota           = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] num_iser_scan_tries            = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] num_shell_tries                = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] num_volume_device_scan_tries   = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] nvmeof_conn_info_version       = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] nvmet_ns_id                    = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] nvmet_port_id                  = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] osapi_max_limit                = 1000 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] osapi_volume_ext_list          = [] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] osapi_volume_listen_port       = 8776 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] osapi_volume_use_ssl           = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] osapi_volume_workers           = 2 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] per_volume_size_limit          = -1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] periodic_fuzzy_delay           = 60 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] periodic_interval              = 60 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] public_endpoint                = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] publish_errors                 = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] quota_backup_gigabytes         = 1000 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] quota_backups                  = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] quota_gigabytes                = 1000 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] quota_groups                   = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] quota_snapshots                = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] quota_volumes                  = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] rate_limit_burst               = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] rate_limit_except_level        = CRITICAL {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] rate_limit_interval            = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] reinit_driver_count            = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] replication_device             = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] report_discard_supported       = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] report_interval                = 120 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] reservation_clean_interval     = 86400 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] reservation_expire             = 86400 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] reserved_image_namespaces      = [] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] reserved_percentage            = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] rpc_response_timeout           = 120 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] run_external_periodic_tasks    = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] scst_target_driver             = iscsi {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] scst_target_iqn_name           = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_down_time              = 720 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] shell_completion               = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] snapshot_name_template         = snapshot-%s {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] snapshot_same_host             = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] split_loggers                  = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] state_path                     = /opt/stack/data/cinder {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] storage_availability_zone      = nova {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] storage_protocol               = iSCSI {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] syslog_log_facility            = LOG_USER {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] target_helper                  = lioadm {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] target_ip_address              = 192.168.122.50 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] target_port                    = 3260 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] target_protocol                = iscsi {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] target_secondary_ip_addresses  = [] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] trace_flags                    = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] transport_url                  = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] until_refresh                  = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] use_chap_auth                  = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] use_default_quota_class        = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] use_journal                    = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] use_json                       = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] use_multipath_for_image_xfer   = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] use_stderr                     = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] use_syslog                     = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] verify_glance_signatures       = enabled {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_api_class               = cinder.volume.api.API {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_backend_name            = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_clear                   = zero {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_clear_ionice            = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_clear_size              = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_copy_bps_limit          = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_dd_blocksize            = 1M {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_name_template           = volume-%s {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_service_inithost_offload = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volume_usage_audit_period      = month {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] zoning_mode                    = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_concurrency.disable_process_locking = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.admin_password = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.admin_token = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.admin_user  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.auth_port   = 35357 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.auth_protocol = https {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.auth_section = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.auth_type   = password {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.auth_uri    = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.auth_version = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.cache       = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.certfile    = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.delay_auth_decision = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.http_connect_timeout = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.identity_uri = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.include_service_catalog = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.insecure    = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.interface   = public {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.keyfile     = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_password =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcache_username =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.region_name = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.service_token_roles_required = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.service_type = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.token_cache_time = 300 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.backend                  = dogpile.cache.null {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.backend_argument         = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.backend_expiration_time  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.config_prefix            = cache.oslo {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.debug_cache_backend      = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.enable_retry_client      = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.enable_socket_keepalive  = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.enabled                  = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.enforce_fips_mode        = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.expiration_time          = 600 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.hashclient_retry_attempts = 2 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.memcache_dead_retry      = 300 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack sudo[72760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Feb 28 01:16:27 devstack sudo[72760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.memcache_pool_maxsize    = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.memcache_sasl_enabled    = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.password                 = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.proxies                  = [] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.redis_db                 = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.redis_sentinel_service_name = mymaster {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.redis_server             = localhost:6379 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.retry_attempts           = 2 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.retry_delay              = 0.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.socket_keepalive_count   = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.socket_keepalive_idle    = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.socket_keepalive_interval = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.socket_timeout           = 1.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.tls_allowed_ciphers      = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.tls_cafile               = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.tls_certfile             = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.tls_enabled              = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.tls_keyfile              = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cache.username                 = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] coordination.backend_url       = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.asyncio_connection    = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.asyncio_slave_connection = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.backend               = sqlalchemy {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.connection            = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.connection_debug      = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.connection_parameters =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.connection_recycle_time = 3600 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.connection_trace      = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.db_inc_retry_interval = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.db_max_retries        = 20 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.db_max_retry_interval = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.db_retry_interval     = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.max_overflow          = 50 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.max_pool_size         = 5 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.max_retries           = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.mysql_wsrep_sync_wait = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.pool_timeout          = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.retry_interval        = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.slave_connection      = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.sqlite_synchronous    = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.synchronous_reader    = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] database.use_db_reconnect      = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.connection_string     = messaging:// {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.enabled               = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.es_doc_type           = notification {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.es_scroll_size        = 10000 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.es_scroll_time        = 2m {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.filter_error_trace    = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.hmac_keys             = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.sentinel_service_name = mymaster {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.socket_timeout        = 0.1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.trace_requests        = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler.trace_sqlalchemy      = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler_jaeger.process_tags   = {} {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler_jaeger.service_name_prefix = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] profiler_otlp.service_name_prefix = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.enforce_new_defaults = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: WARNING oslo_config.cfg [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.enforce_scope      = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.policy_default_rule = default {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.policy_file        = policy.yaml {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] privsep_osbrick.group          = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] privsep_osbrick.helper_command = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] privsep_osbrick.user           = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cinder_sys_admin.group         = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cinder_sys_admin.helper_command = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] cinder_sys_admin.user          = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_user.auth_section      = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_user.auth_type         = password {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_user.cafile            = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_user.certfile          = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_user.collect_timing    = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_user.insecure          = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_user.keyfile           = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_user.send_service_user_token = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_user.split_loggers     = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] service_user.timeout           = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance.auth_section            = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance.auth_type               = password {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance.certfile                = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance.collect_timing          = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance.insecure                = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance.keyfile                 = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance.region_name             = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance.split_loggers           = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] glance.timeout                 = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.backend_availability_zone = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.chap_password = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.chap_username =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.disk_geometry = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.driver_client_cert = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.driver_client_cert_key = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.driver_data_namespace = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.driver_use_ssl = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.enable_unsupported_driver = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.extra_capabilities = {} {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.filter_function = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.goodness_function = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.iscsi_target_flags =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.iscsi_write_cache = on {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.iser_helper   = tgtadm {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.iser_port     = 3260 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.lvm_share_target = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.lvm_type      = auto {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.num_shell_tries = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.nvmet_port_id = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.replication_device = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.report_discard_supported = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.reserved_percentage = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.scst_target_driver = iscsi {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.scst_target_iqn_name = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.storage_protocol = iSCSI {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.target_helper = tgtadm {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.target_port   = 3260 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.target_protocol = iscsi {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.trace_flags   = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.unique_fqdn_network = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.use_chap_auth = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.volume_backend_name = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.volume_clear  = zero {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.volume_clear_ionice = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.volume_clear_size = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_reports.file_event_handler = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_reports.log_dir           = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.backend_availability_zone = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.backend_host       = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.chap_password      = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.chap_username      = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.disk_geometry      = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.driver_client_cert = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.driver_data_namespace = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.extra_capabilities = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.filter_function    = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.goodness_function  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.iser_helper        = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.iser_ip_address    = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.iser_port          = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.iser_target_prefix = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.lvm_share_target   = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.lvm_type           = auto {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.num_shell_tries    = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.replication_device = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.report_discard_supported = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.reserved_percentage = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.scst_target_driver = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.storage_protocol   = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.target_helper      = lioadm {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.target_ip_address  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.target_port        = 3260 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.trace_flags        = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.use_chap_auth      = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.volume_clear       = zero {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.volume_clear_size  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] lvmdriver-1.volumes_dir        = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.ssl      = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_notifications.driver = [] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_notifications.retry = -1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] oslo_messaging_notifications.transport_url = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] key_manager.fixed_key          = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.barbican_api_version  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.barbican_endpoint     = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.barbican_endpoint_type = public {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.barbican_region_name  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.cafile                = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.certfile              = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.collect_timing        = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.insecure              = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.keyfile               = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.number_of_retries     = 60 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.retry_delay           = 1 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.send_service_user_token = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.split_loggers         = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.timeout               = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.verify_ssl            = True {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican.verify_ssl_path       = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican_service_user.auth_section = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican_service_user.auth_type = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican_service_user.cafile   = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican_service_user.certfile = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican_service_user.collect_timing = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican_service_user.insecure = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican_service_user.keyfile  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican_service_user.split_loggers = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] barbican_service_user.timeout  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.approle_role_id          = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.approle_secret_id        = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.kv_mountpoint            = secret {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.kv_path                  = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.kv_version               = 2 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.namespace                = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.root_token_id            = **** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.ssl_ca_crt_file          = None {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.timeout                  = 60.0 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.use_ssl                  = False {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:16:27 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] ******************************************************************************** {{(pid=72656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 28 01:16:27 devstack sudo[72760]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:27 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:27 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:27 devstack sudo[72769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:16:27 devstack sudo[72769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:28 devstack sudo[72769]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:28 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.517s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:28 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:16:28 devstack cinder-volume[72756]: INFO cinder.brick.local_dev.lvm [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Feb 28 01:16:28 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:28 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:28 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:28 devstack sudo[72999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 01:16:28 devstack sudo[72999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:29 devstack sudo[72999]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:29 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:29 devstack cinder-volume[72756]: DEBUG cinder.brick.local_dev.lvm [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72756) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Feb 28 01:16:29 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:29 devstack sudo[73201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:16:29 devstack sudo[73201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:30 devstack sudo[73201]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:30 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.249s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:30 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:30 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:30 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:30 devstack sudo[73397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:16:30 devstack sudo[73397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:30 devstack sudo[73397]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:30 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:30 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:30 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:30 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:30 devstack sudo[73446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Feb 28 01:16:30 devstack sudo[73446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:31 devstack sudo[73446]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:31 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.424s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:31 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:31 devstack sudo[73449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 01:16:31 devstack sudo[73449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:31 devstack sudo[73449]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:31 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:31 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:31 devstack sudo[73458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 01:16:31 devstack sudo[73458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:32 devstack sudo[73458]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:32 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:32 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:32 devstack sudo[73461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:16:32 devstack sudo[73461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:32 devstack sudo[73461]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:32 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:32 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:32 devstack sudo[73466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:16:32 devstack sudo[73466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:32 devstack sudo[73466]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:32 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.416s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:32 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:33 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:33 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:33 devstack sudo[73470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:16:33 devstack sudo[73470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:33 devstack sudo[73470]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:33 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.414s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:33 devstack cinder-volume[72756]: INFO cinder.volume.drivers.lvm [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Feb 28 01:16:33 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:33 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:33 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:33 devstack sudo[73478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:16:33 devstack sudo[73478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:34 devstack sudo[73478]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:34 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.576s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:34 devstack cinder-volume[72756]: DEBUG cinder.volume.drivers.lvm [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Updating volume stats {{(pid=72756) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 01:16:34 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:34 devstack sudo[73595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 01:16:34 devstack sudo[73595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:34 devstack sudo[73595]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:34 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:34 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:34 devstack sudo[73598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:16:34 devstack sudo[73598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:34 devstack sudo[73598]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:34 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:34 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:34 devstack sudo[73768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:16:34 devstack sudo[73768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:35 devstack sudo[73768]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:35 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:35 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:35 devstack sudo[73774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:16:35 devstack sudo[73774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:35 devstack sudo[73774]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:35 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:35 devstack cinder-volume[72756]: INFO cinder.volume.driver [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Driver hasn't implemented _init_vendor_properties()
Feb 28 01:16:35 devstack cinder-volume[72756]: DEBUG cinder.volume.driver [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72756) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 28 01:16:35 devstack cinder-volume[72756]: DEBUG oslo_db.sqlalchemy.engines [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72756) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:16:35 devstack cinder-volume[72756]: DEBUG dbcounter [-] [72756] Writer thread running {{(pid=72756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 01:16:35 devstack cinder-volume[72756]: DEBUG cinder.db.sqlalchemy.api [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Building query based on filter {{(pid=72756) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 28 01:16:35 devstack cinder-volume[72756]: DEBUG cinder.image.image_utils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72756) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 28 01:16:35 devstack cinder-volume[72756]: INFO cinder.keymgr.migration [None req-7139f421-e4cf-4ee5-8576-ac7e51792a56 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 28 01:16:35 devstack cinder-volume[72756]: DEBUG cinder.volume.drivers.lvm [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Updating volume stats {{(pid=72756) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 01:16:35 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:35 devstack sudo[73782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 01:16:35 devstack sudo[73782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:36 devstack sudo[73782]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:36 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:36 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:36 devstack sudo[73785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:16:36 devstack sudo[73785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:36 devstack sudo[73785]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:36 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:36 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:36 devstack sudo[73788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:16:36 devstack sudo[73788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:37 devstack cinder-volume[72656]: DEBUG dbcounter [-] [72656] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:16:37 devstack sudo[73788]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:37 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:37 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:37 devstack sudo[73795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:16:37 devstack sudo[73795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:37 devstack sudo[73795]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:37 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:37 devstack cinder-volume[72756]: DEBUG cinder.manager [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Notifying Schedulers of capabilities ... {{(pid=72756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:16:37 devstack cinder-volume[72756]: INFO cinder.volume.manager [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Driver initialization completed successfully.
Feb 28 01:16:37 devstack cinder-volume[72756]: INFO cinder.manager [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Initiating service 2 cleanup
Feb 28 01:16:37 devstack cinder-volume[72756]: INFO cinder.manager [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Service 2 cleanup completed.
Feb 28 01:16:37 devstack cinder-volume[72756]: DEBUG cinder.service [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Creating RPC server for service cinder-volume {{(pid=72756) start /opt/stack/cinder/cinder/service.py:231}}
Feb 28 01:16:37 devstack cinder-volume[72756]: DEBUG cinder.service [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72756) start /opt/stack/cinder/cinder/service.py:237}}
Feb 28 01:16:37 devstack cinder-volume[72756]: INFO cinder.volume.manager [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Feb 28 01:16:37 devstack cinder-volume[72756]: DEBUG cinder.volume.drivers.lvm [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Updating volume stats {{(pid=72756) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 01:16:37 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:37 devstack sudo[73803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 01:16:37 devstack sudo[73803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:38 devstack sudo[73803]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:38 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:38 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:38 devstack sudo[73806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:16:38 devstack sudo[73806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:38 devstack sudo[73806]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:38 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:38 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:38 devstack sudo[73863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:16:38 devstack sudo[73863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:39 devstack sudo[73863]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:39 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.457s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:39 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:16:39 devstack sudo[73866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:16:39 devstack sudo[73866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:16:39 devstack sudo[73866]: pam_unix(sudo:session): session closed for user root
Feb 28 01:16:39 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:16:39 devstack cinder-volume[72756]: INFO cinder.volume.manager [None req-862e2b95-fbb9-4d5b-9ff5-4cef061e49c0 None None] Driver post RPC initialization completed successfully.
Feb 28 01:16:47 devstack cinder-volume[72756]: DEBUG dbcounter [-] [72756] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:16:49 devstack cinder-volume[72756]: DEBUG dbcounter [-] [72756] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:17:46 devstack cinder-volume[72756]: DEBUG oslo_service.periodic_task [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:17:46 devstack cinder-volume[72756]: DEBUG cinder.volume.drivers.lvm [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Updating volume stats {{(pid=72756) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 01:17:46 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:17:46 devstack sudo[78221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 01:17:46 devstack sudo[78221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:17:47 devstack sudo[78221]: pam_unix(sudo:session): session closed for user root
Feb 28 01:17:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:17:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:17:47 devstack sudo[78609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:17:47 devstack sudo[78609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:17:47 devstack sudo[78609]: pam_unix(sudo:session): session closed for user root
Feb 28 01:17:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:17:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:17:47 devstack sudo[78740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:17:47 devstack sudo[78740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:17:48 devstack sudo[78740]: pam_unix(sudo:session): session closed for user root
Feb 28 01:17:48 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.413s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:17:48 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:17:48 devstack sudo[78764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:17:48 devstack sudo[78764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:17:48 devstack sudo[78764]: pam_unix(sudo:session): session closed for user root
Feb 28 01:17:48 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.413s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:17:48 devstack cinder-volume[72756]: DEBUG cinder.manager [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Notifying Schedulers of capabilities ... {{(pid=72756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:18:46 devstack cinder-volume[72756]: DEBUG oslo_service.periodic_task [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:18:46 devstack cinder-volume[72756]: DEBUG cinder.volume.drivers.lvm [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Updating volume stats {{(pid=72756) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 01:18:46 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:18:46 devstack sudo[79664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 01:18:46 devstack sudo[79664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:18:47 devstack sudo[79664]: pam_unix(sudo:session): session closed for user root
Feb 28 01:18:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:18:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:18:47 devstack sudo[79678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:18:47 devstack sudo[79678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:18:47 devstack sudo[79678]: pam_unix(sudo:session): session closed for user root
Feb 28 01:18:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:18:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:18:47 devstack sudo[79718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:18:47 devstack sudo[79718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:18:48 devstack sudo[79718]: pam_unix(sudo:session): session closed for user root
Feb 28 01:18:48 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:18:48 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:18:48 devstack sudo[79759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:18:48 devstack sudo[79759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:18:48 devstack sudo[79759]: pam_unix(sudo:session): session closed for user root
Feb 28 01:18:48 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:18:48 devstack cinder-volume[72756]: DEBUG cinder.manager [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Notifying Schedulers of capabilities ... {{(pid=72756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:18:49 devstack cinder-volume[72756]: DEBUG dbcounter [-] [72756] Writing DB stats cinder:SELECT=1 {{(pid=72756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:18:49 devstack cinder-volume[72756]: DEBUG dbcounter [-] [72756] Writing DB stats cinder:UPDATE=1 {{(pid=72756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:19:46 devstack cinder-volume[72756]: DEBUG oslo_service.periodic_task [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:19:46 devstack cinder-volume[72756]: DEBUG cinder.volume.drivers.lvm [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Updating volume stats {{(pid=72756) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 28 01:19:46 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:19:46 devstack sudo[81287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 28 01:19:46 devstack sudo[81287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:19:47 devstack sudo[81287]: pam_unix(sudo:session): session closed for user root
Feb 28 01:19:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:19:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:19:47 devstack sudo[81310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:19:47 devstack sudo[81310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:19:47 devstack sudo[81310]: pam_unix(sudo:session): session closed for user root
Feb 28 01:19:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:19:47 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:19:47 devstack sudo[81316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 28 01:19:47 devstack sudo[81316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:19:48 devstack sudo[81316]: pam_unix(sudo:session): session closed for user root
Feb 28 01:19:48 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:19:48 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:19:48 devstack sudo[81371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 28 01:19:48 devstack sudo[81371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:19:48 devstack sudo[81371]: pam_unix(sudo:session): session closed for user root
Feb 28 01:19:48 devstack cinder-volume[72756]: DEBUG oslo_concurrency.processutils [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:19:48 devstack cinder-volume[72756]: DEBUG cinder.manager [None req-8685fd77-cb53-4958-baee-0859acb9b395 None None] Notifying Schedulers of capabilities ... {{(pid=72756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:20:11 devstack cinder-volume[72656]: INFO oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Caught SIGTERM, stopping children
Feb 28 01:20:11 devstack cinder-volume[72656]: DEBUG oslo_concurrency.lockutils [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Acquiring lock "singleton_lock" {{(pid=72656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 01:20:11 devstack cinder-volume[72656]: DEBUG oslo_concurrency.lockutils [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Acquired lock "singleton_lock" {{(pid=72656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 01:20:11 devstack cinder-volume[72656]: DEBUG oslo_concurrency.lockutils [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Releasing lock "singleton_lock" {{(pid=72656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 01:20:11 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Stop services. {{(pid=72656) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Feb 28 01:20:11 devstack cinder-volume[72656]: DEBUG oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Killing children. {{(pid=72656) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Feb 28 01:20:11 devstack cinder-volume[72656]: INFO oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Waiting on 1 children to exit
Feb 28 01:20:12 devstack cinder-volume[72756]: DEBUG oslo_concurrency.lockutils [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Acquiring lock "singleton_lock" {{(pid=72756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 01:20:12 devstack cinder-volume[72756]: DEBUG oslo_concurrency.lockutils [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Acquired lock "singleton_lock" {{(pid=72756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 01:20:12 devstack cinder-volume[72756]: DEBUG oslo_concurrency.lockutils [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Releasing lock "singleton_lock" {{(pid=72756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 01:20:12 devstack cinder-volume[72756]: WARNING amqp [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 28 01:20:12 devstack cinder-volume[72756]: WARNING amqp [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 28 01:20:12 devstack cinder-volume[72656]: INFO oslo_service.backend._eventlet.service [None req-49508929-8eb7-4195-bafa-7be81267ba2e None None] Child 72756 exited with status 0
Feb 28 01:20:15 devstack cinder-volume[81977]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81977) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 01:20:15 devstack cinder-volume[81977]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81977) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 01:20:15 devstack cinder-volume[81977]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81977) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 01:20:15 devstack cinder-volume[81977]: INFO dbcounter [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Registered counter for database cinder
Feb 28 01:20:15 devstack cinder-volume[81977]: DEBUG oslo_db.sqlalchemy.engines [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81977) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:20:15 devstack cinder-volume[81977]: DEBUG dbcounter [-] [81977] Writer thread running {{(pid=81977) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 01:20:15 devstack cinder-volume[81977]: INFO cinder.rpc [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 28 01:20:15 devstack cinder-volume[81977]: INFO cinder.rpc [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 28 01:20:15 devstack cinder-volume[81977]: DEBUG oslo_db.sqlalchemy.engines [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81977) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:20:15 devstack cinder-volume[81977]: INFO cinder.volume.manager [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Determined volume DB was empty at startup.
Feb 28 01:20:15 devstack cinder-volume[81977]: DEBUG cinder.volume.manager [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81977) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 28 01:20:15 devstack cinder-volume[81977]: INFO cinder.volume.manager [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Service not found for updating active_backend_id, assuming default for driver init.
Feb 28 01:20:15 devstack cinder-volume[81977]: WARNING stevedore.named [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 28 01:20:15 devstack cinder-volume[81977]: WARNING castellan.key_manager [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 01:20:15 devstack cinder-volume[81977]: WARNING cinder.keymgr.conf_key_mgr [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 01:20:16 devstack cinder-volume[81977]: INFO cinder.volume.manager [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_db.sqlalchemy.engines [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81977) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:20:16 devstack cinder-volume[81977]: INFO oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Starting 1 workers
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Started child 82095 {{(pid=81977) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Full set of CONF: {{(pid=81977) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] ******************************************************************************** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Configuration options gathered from: {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] ================================================================================ {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] allow_availability_zone_fallback = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] allow_compression_on_image_upload = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] allowed_direct_url_schemes     = [] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[82095]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] api_rate_limit                 = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] auth_strategy                  = keystone {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_availability_zone      = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_host                   = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_name                   = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_stats_polling_interval = 60 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backup_api_class               = cinder.backup.api.API {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backup_name_template           = backup-%s {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backup_use_same_host           = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backup_use_temp_snapshot       = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] chap_password                  = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] chap_username                  =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cinder_internal_tenant_project_id = bf6c0c6fa1eb49d7aaacd98237bf7cac {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cinder_internal_tenant_user_id = 95d2b1be107648fc8078507325220906 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cluster                        = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] compression_format             = gzip {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] compute_api_class              = cinder.compute.nova.API {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] config_dir                     = [] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] config_source                  = [] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] control_exchange               = openstack {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] debug                          = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] default_availability_zone      = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] default_group_type             = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] default_volume_type            = QuobyteHD {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] disk_geometry                  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] driver_client_cert             = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] driver_client_cert_key         = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] driver_data_namespace          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] driver_ssl_cert_path           = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] driver_ssl_cert_verify         = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] driver_use_ssl                 = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] enable_new_services            = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] enable_unsupported_driver      = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] enabled_backends               = ['QuobyteHD'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] enforce_multipath_for_image_xfer = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] filter_function                = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance_api_insecure            = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance_api_servers             = ['http://192.168.122.50/image'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance_api_ssl_compression     = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance_ca_certificates_file    = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance_catalog_info            = image:glance:publicURL {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance_certfile                = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance_keyfile                 = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance_num_retries             = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance_request_timeout         = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] goodness_function              = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] graceful_shutdown_timeout      = 5 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] group_api_class                = cinder.group.api.API {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] host                           = devstack {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] image_compress_on_upload       = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] image_conversion_address_space_limit = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] image_conversion_cpu_limit     = 60 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] image_conversion_disable       = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] image_upload_use_cinder_backend = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] image_upload_use_internal_tenant = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] image_volume_cache_enabled     = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] image_volume_cache_max_count   = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] image_volume_cache_max_size_gb = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] init_host_max_objects_retrieval = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] instance_format                = [instance: %(uuid)s]  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] iscsi_target_flags             =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] iscsi_write_cache              = on {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] iser_helper                    = tgtadm {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] iser_ip_address                = 192.168.122.50 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] iser_port                      = 3260 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] log_color                      = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] log_config_append              = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] log_dir                        = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] log_file                       = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] log_options                    = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] log_rotate_interval            = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] log_rotate_interval_type       = days {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] log_rotation_type              = none {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] max_age                        = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] max_logfile_count              = 30 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] max_logfile_size_mb            = 200 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] max_over_subscription_ratio    = 20.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] message_reap_interval          = 86400 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] message_ttl                    = 2592000 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] migration_create_volume_timeout_secs = 300 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] monkey_patch                   = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] monkey_patch_modules           = [] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] my_ip                          = 192.168.122.50 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] no_snapshot_gb_quota           = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] num_iser_scan_tries            = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] num_shell_tries                = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] num_volume_device_scan_tries   = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] nvmeof_conn_info_version       = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] nvmet_ns_id                    = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] nvmet_port_id                  = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] osapi_max_limit                = 1000 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] osapi_volume_ext_list          = [] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] osapi_volume_listen_port       = 8776 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] osapi_volume_use_ssl           = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] osapi_volume_workers           = 2 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] per_volume_size_limit          = -1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] periodic_fuzzy_delay           = 60 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] periodic_interval              = 60 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[82095]: INFO cinder.volume.manager [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Starting volume driver QuobyteDriver (1.1.14)
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG cinder.volume.drivers.remotefs [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82095) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] public_endpoint                = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] publish_errors                 = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] quota_backup_gigabytes         = 1000 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] quota_backups                  = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] quota_gigabytes                = 1000 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] quota_groups                   = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] quota_snapshots                = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] quota_volumes                  = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] rate_limit_burst               = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] rate_limit_except_level        = CRITICAL {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] rate_limit_interval            = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] reinit_driver_count            = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] replication_device             = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] report_discard_supported       = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] report_interval                = 120 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] reservation_clean_interval     = 86400 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] reservation_expire             = 86400 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] reserved_image_namespaces      = [] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] reserved_percentage            = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] rpc_response_timeout           = 120 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] run_external_periodic_tasks    = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] scst_target_driver             = iscsi {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] scst_target_iqn_name           = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_down_time              = 720 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] shell_completion               = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] snapshot_name_template         = snapshot-%s {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] split_loggers                  = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] state_path                     = /opt/stack/data/cinder {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] storage_availability_zone      = nova {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] storage_protocol               = iSCSI {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] syslog_log_facility            = LOG_USER {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] target_helper                  = lioadm {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] target_ip_address              = 192.168.122.50 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] target_port                    = 3260 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] target_protocol                = iscsi {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] target_secondary_ip_addresses  = [] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] trace_flags                    = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] transport_url                  = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] until_refresh                  = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] use_chap_auth                  = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] use_default_quota_class        = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] use_journal                    = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] use_json                       = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] use_multipath_for_image_xfer   = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] use_stderr                     = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] use_syslog                     = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] verify_glance_signatures       = enabled {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_api_class               = cinder.volume.api.API {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_backend_name            = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_clear                   = zero {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_clear_ionice            = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_clear_size              = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_copy_bps_limit          = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_dd_blocksize            = 1M {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_name_template           = volume-%s {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_service_inithost_offload = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volume_usage_audit_period      = month {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] zoning_mode                    = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_concurrency.disable_process_locking = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.admin_password = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.admin_token = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.admin_user  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.auth_port   = 35357 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.auth_protocol = https {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.auth_section = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.auth_type   = password {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.auth_uri    = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.auth_version = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.cache       = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.certfile    = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.delay_auth_decision = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.http_connect_timeout = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.identity_uri = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.include_service_catalog = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.insecure    = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.interface   = public {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.keyfile     = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_password =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcache_username =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.region_name = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.service_token_roles_required = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.service_type = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.token_cache_time = 300 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.backend                  = dogpile.cache.null {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.backend_argument         = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.backend_expiration_time  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.config_prefix            = cache.oslo {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.debug_cache_backend      = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.enable_retry_client      = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.enable_socket_keepalive  = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.enabled                  = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.enforce_fips_mode        = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.expiration_time          = 600 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.hashclient_retry_attempts = 2 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.memcache_dead_retry      = 300 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.memcache_pool_maxsize    = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.memcache_sasl_enabled    = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.password                 = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.proxies                  = [] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.redis_db                 = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.redis_sentinel_service_name = mymaster {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.redis_server             = localhost:6379 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.retry_attempts           = 2 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.retry_delay              = 0.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.socket_keepalive_count   = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.socket_keepalive_idle    = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.socket_keepalive_interval = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.socket_timeout           = 1.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.tls_allowed_ciphers      = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.tls_cafile               = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.tls_certfile             = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.tls_enabled              = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.tls_keyfile              = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cache.username                 = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] coordination.backend_url       = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.asyncio_connection    = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.asyncio_slave_connection = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.backend               = sqlalchemy {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.connection            = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.connection_debug      = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.connection_parameters =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.connection_recycle_time = 3600 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.connection_trace      = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.db_inc_retry_interval = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.db_max_retries        = 20 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.db_max_retry_interval = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.db_retry_interval     = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.max_overflow          = 50 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.max_pool_size         = 5 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.max_retries           = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.mysql_wsrep_sync_wait = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.pool_timeout          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.retry_interval        = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.slave_connection      = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.sqlite_synchronous    = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.synchronous_reader    = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] database.use_db_reconnect      = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82095) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.connection_string     = messaging:// {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.enabled               = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.es_doc_type           = notification {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.es_scroll_size        = 10000 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.es_scroll_time        = 2m {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[82095]: WARNING cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.filter_error_trace    = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[82095]: WARNING cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.hmac_keys             = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.sentinel_service_name = mymaster {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.socket_timeout        = 0.1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.trace_requests        = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler.trace_sqlalchemy      = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler_jaeger.process_tags   = {} {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler_jaeger.service_name_prefix = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] profiler_otlp.service_name_prefix = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.enforce_new_defaults = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Running cmd (subprocess): mount.quobyte {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:20:16 devstack cinder-volume[81977]: WARNING oslo_config.cfg [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.enforce_scope      = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.policy_default_rule = default {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.policy_file        = policy.yaml {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] privsep_osbrick.group          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] privsep_osbrick.helper_command = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] privsep_osbrick.user           = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cinder_sys_admin.group         = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cinder_sys_admin.helper_command = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] cinder_sys_admin.user          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_user.auth_section      = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_user.auth_type         = password {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_user.cafile            = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_user.certfile          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_user.collect_timing    = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_user.insecure          = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_user.keyfile           = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_user.send_service_user_token = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_user.split_loggers     = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] service_user.timeout           = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance.auth_section            = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance.auth_type               = password {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance.certfile                = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance.collect_timing          = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance.insecure                = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance.keyfile                 = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance.region_name             = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance.split_loggers           = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] glance.timeout                 = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.backend_availability_zone = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.chap_password = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.chap_username =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.disk_geometry = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.driver_client_cert = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.driver_client_cert_key = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.driver_data_namespace = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.driver_use_ssl = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.enable_unsupported_driver = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.extra_capabilities = {} {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.filter_function = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.goodness_function = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.iscsi_target_flags =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.iscsi_write_cache = on {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.iser_helper   = tgtadm {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.iser_port     = 3260 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nas_host      =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nas_login     = admin {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nas_mount_options = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nas_password  = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nas_private_key =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nas_share_path =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.num_shell_tries = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.nvmet_port_id = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.quobyte_client_cfg = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.quobyte_volume_url = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.replication_device = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.report_discard_supported = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.reserved_percentage = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.scst_target_driver = iscsi {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.scst_target_iqn_name = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.storage_protocol = iSCSI {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.target_helper = tgtadm {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.target_port   = 3260 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.target_protocol = iscsi {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.trace_flags   = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.unique_fqdn_network = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.use_chap_auth = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.volume_backend_name = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.volume_clear  = zero {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.volume_clear_ionice = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.volume_clear_size = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_reports.file_event_handler = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_reports.log_dir           = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.backend_availability_zone = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.backend_host         = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.chap_password        = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.chap_username        = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.chiscsi_conf         = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.disk_geometry        = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.driver_client_cert   = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.driver_client_cert_key = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.driver_data_namespace = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.driver_use_ssl       = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.extra_capabilities   = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.filter_function      = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.goodness_function    = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.iser_helper          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.iser_ip_address      = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.iser_port            = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.iser_target_prefix   = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nas_host             = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nas_login            = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nas_mount_options    = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nas_password         = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nas_private_key      = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nas_share_path       = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nas_ssh_port         = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.num_shell_tries      = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.nvmet_port_id        = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.replication_device   = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.report_discard_supported = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.reserved_percentage  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.scst_target_driver   = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.storage_protocol     = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.target_helper        = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.target_ip_address    = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.target_port          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.target_prefix        = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.target_protocol      = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.trace_flags          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.use_chap_auth        = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.volume_clear         = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.volume_clear_size    = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] QuobyteHD.volumes_dir          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack quobyte-client[82096]: Reading configuration file: /etc/quobyte/client.cfg
Feb 28 01:20:16 devstack quobyte-client[82096]: Invalid parameters found, error: missing mount point.
Feb 28 01:20:16 devstack quobyte-client[82096]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Feb 28 01:20:16 devstack quobyte-client[82096]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] CMD "mount.quobyte" returned: 1 in 0.098s {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.ssl      = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[82095]: INFO cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc ...
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 -c /etc/quobyte/client-cinder.cfg {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_notifications.driver = [] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_notifications.retry = -1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] oslo_messaging_notifications.transport_url = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] key_manager.fixed_key          = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.barbican_api_version  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.barbican_endpoint     = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.barbican_endpoint_type = public {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.barbican_region_name  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.cafile                = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.certfile              = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.collect_timing        = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.insecure              = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.keyfile               = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.number_of_retries     = 60 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.retry_delay           = 1 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.send_service_user_token = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.split_loggers         = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.timeout               = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.verify_ssl            = True {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican.verify_ssl_path       = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican_service_user.auth_section = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican_service_user.auth_type = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican_service_user.cafile   = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican_service_user.certfile = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican_service_user.collect_timing = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican_service_user.insecure = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican_service_user.keyfile  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican_service_user.split_loggers = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] barbican_service_user.timeout  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.approle_role_id          = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.approle_secret_id        = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.kv_mountpoint            = secret {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.kv_path                  = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.kv_version               = 2 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.namespace                = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.root_token_id            = **** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.ssl_ca_crt_file          = None {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack sudo[82097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 -c /etc/quobyte/client-cinder.cfg
Feb 28 01:20:16 devstack sudo[82097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.timeout                  = 60.0 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.use_ssl                  = False {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:16 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] ******************************************************************************** {{(pid=81977) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 28 01:20:16 devstack sudo[82097]: pam_unix(sudo:session): session closed for user root
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.540s {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:20:16 devstack cinder-volume[82095]: INFO cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc succeeded
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.564s {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:20:16 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:20:16 devstack sudo[82166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:20:16 devstack sudo[82166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:20:17 devstack sudo[82166]: pam_unix(sudo:session): session closed for user root
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.395s {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:20:17 devstack cinder-volume[82095]: INFO cinder.volume.driver [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Driver hasn't implemented _init_vendor_properties()
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG cinder.volume.driver [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580757141113, 'free_capacity_gb': 1775.7580757141113, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82095) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_db.sqlalchemy.engines [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG dbcounter [-] [82095] Writer thread running {{(pid=82095) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG cinder.db.sqlalchemy.api [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Building query based on filter {{(pid=82095) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG cinder.image.image_utils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82095) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 28 01:20:17 devstack cinder-volume[82095]: INFO cinder.keymgr.migration [None req-c431c578-2bae-4669-82e2-2cd70c65705d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:20:17 devstack sudo[82174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:20:17 devstack sudo[82174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:20:17 devstack sudo[82174]: pam_unix(sudo:session): session closed for user root
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.419s {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG cinder.manager [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Notifying Schedulers of capabilities ... {{(pid=82095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:20:17 devstack cinder-volume[82095]: INFO cinder.volume.manager [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Driver initialization completed successfully.
Feb 28 01:20:17 devstack cinder-volume[82095]: INFO cinder.manager [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Initiating service 3 cleanup
Feb 28 01:20:17 devstack cinder-volume[82095]: INFO cinder.manager [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Service 3 cleanup completed.
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG cinder.service [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Creating RPC server for service cinder-volume {{(pid=82095) start /opt/stack/cinder/cinder/service.py:231}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG cinder.service [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82095) start /opt/stack/cinder/cinder/service.py:237}}
Feb 28 01:20:17 devstack cinder-volume[82095]: INFO cinder.volume.manager [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:20:17 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:20:17 devstack sudo[82198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:20:17 devstack sudo[82198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:20:18 devstack sudo[82198]: pam_unix(sudo:session): session closed for user root
Feb 28 01:20:18 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.659s {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:20:18 devstack cinder-volume[82095]: INFO cinder.volume.manager [None req-bc8a40ff-ab5c-4be8-ad03-31725fac4c90 None None] Driver post RPC initialization completed successfully.
Feb 28 01:20:20 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-754ce77d-9772-428a-9cc3-46014bd1111f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:20:20 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-754ce77d-9772-428a-9cc3-46014bd1111f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:20:20 devstack cinder-volume[82095]: DEBUG cinder.volume.drivers.quobyte [None req-754ce77d-9772-428a-9cc3-46014bd1111f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:20:20 devstack cinder-volume[82095]: DEBUG cinder.volume.drivers.quobyte [None req-754ce77d-9772-428a-9cc3-46014bd1111f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:20:20 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-754ce77d-9772-428a-9cc3-46014bd1111f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:20:20 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-754ce77d-9772-428a-9cc3-46014bd1111f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:20:20 devstack sudo[82239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:20:20 devstack sudo[82239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:20:20 devstack sudo[82239]: pam_unix(sudo:session): session closed for user root
Feb 28 01:20:20 devstack cinder-volume[82095]: DEBUG oslo_concurrency.processutils [None req-754ce77d-9772-428a-9cc3-46014bd1111f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.399s {{(pid=82095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:20:20 devstack cinder-volume[82095]: DEBUG cinder.manager [None req-754ce77d-9772-428a-9cc3-46014bd1111f None None] Notifying Schedulers of capabilities ... {{(pid=82095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:20:21 devstack cinder-volume[81977]: INFO oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Caught SIGTERM, stopping children
Feb 28 01:20:21 devstack cinder-volume[81977]: DEBUG oslo_concurrency.lockutils [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Acquiring lock "singleton_lock" {{(pid=81977) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 01:20:21 devstack cinder-volume[81977]: DEBUG oslo_concurrency.lockutils [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Acquired lock "singleton_lock" {{(pid=81977) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 01:20:21 devstack cinder-volume[81977]: DEBUG oslo_concurrency.lockutils [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Releasing lock "singleton_lock" {{(pid=81977) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 01:20:21 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Stop services. {{(pid=81977) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Feb 28 01:20:21 devstack cinder-volume[81977]: DEBUG oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Killing children. {{(pid=81977) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Feb 28 01:20:21 devstack cinder-volume[81977]: INFO oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Waiting on 1 children to exit
Feb 28 01:20:26 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Acquiring lock "singleton_lock" {{(pid=82095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 01:20:26 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Acquired lock "singleton_lock" {{(pid=82095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 01:20:26 devstack cinder-volume[82095]: DEBUG oslo_concurrency.lockutils [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Releasing lock "singleton_lock" {{(pid=82095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 01:20:26 devstack cinder-volume[82095]: WARNING amqp [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 28 01:20:26 devstack cinder-volume[82095]: WARNING amqp [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 28 01:20:26 devstack cinder-volume[81977]: INFO oslo_service.backend._eventlet.service [None req-2ba0c571-c23c-43a1-8f8d-1c80c74c1d6b None None] Child 82095 exited with status 0
Feb 28 01:20:27 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 28 01:20:27 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 28 01:20:27 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 28 01:20:28 devstack cinder-volume[82323]: INFO dbcounter [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Registered counter for database cinder
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_db.sqlalchemy.engines [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG dbcounter [-] [82323] Writer thread running {{(pid=82323) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 01:20:28 devstack cinder-volume[82323]: INFO cinder.rpc [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 28 01:20:28 devstack cinder-volume[82323]: INFO cinder.rpc [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_db.sqlalchemy.engines [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:20:28 devstack cinder-volume[82323]: INFO cinder.volume.manager [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Determined volume DB was empty at startup.
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG cinder.volume.manager [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82323) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 28 01:20:28 devstack cinder-volume[82323]: WARNING stevedore.named [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 28 01:20:28 devstack cinder-volume[82323]: WARNING castellan.key_manager [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 01:20:28 devstack cinder-volume[82323]: WARNING cinder.keymgr.conf_key_mgr [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 28 01:20:28 devstack cinder-volume[82323]: INFO cinder.volume.manager [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Image-volume cache disabled for host devstack@QuobyteHD.
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_db.sqlalchemy.engines [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:20:28 devstack cinder-volume[82323]: INFO oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Starting 1 workers
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Started child 82470 {{(pid=82323) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Full set of CONF: {{(pid=82323) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] ******************************************************************************** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Configuration options gathered from: {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] ================================================================================ {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] allow_availability_zone_fallback = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] allow_compression_on_image_upload = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] allowed_direct_url_schemes     = [] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] api_rate_limit                 = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] auth_strategy                  = keystone {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_availability_zone      = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_host                   = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_name                   = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_stats_polling_interval = 60 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backup_api_class               = cinder.backup.api.API {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backup_name_template           = backup-%s {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backup_use_same_host           = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backup_use_temp_snapshot       = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] chap_password                  = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] chap_username                  =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cinder_internal_tenant_project_id = bf6c0c6fa1eb49d7aaacd98237bf7cac {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cinder_internal_tenant_user_id = 95d2b1be107648fc8078507325220906 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cluster                        = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] compression_format             = gzip {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] compute_api_class              = cinder.compute.nova.API {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] config_dir                     = [] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] config_source                  = [] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] control_exchange               = openstack {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] debug                          = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] default_availability_zone      = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] default_group_type             = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] default_volume_type            = QuobyteHD {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] disk_geometry                  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] driver_client_cert             = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] driver_client_cert_key         = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] driver_data_namespace          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] driver_ssl_cert_path           = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] driver_ssl_cert_verify         = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] driver_use_ssl                 = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] enable_new_services            = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] enable_unsupported_driver      = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] enabled_backends               = ['QuobyteHD'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] enforce_multipath_for_image_xfer = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] filter_function                = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance_api_insecure            = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance_api_servers             = ['http://192.168.122.50/image'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance_api_ssl_compression     = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance_ca_certificates_file    = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance_catalog_info            = image:glance:publicURL {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance_certfile                = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance_keyfile                 = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance_num_retries             = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance_request_timeout         = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] goodness_function              = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] graceful_shutdown_timeout      = 5 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] group_api_class                = cinder.group.api.API {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] host                           = devstack {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] image_compress_on_upload       = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] image_conversion_address_space_limit = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] image_conversion_cpu_limit     = 60 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] image_conversion_disable       = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] image_upload_use_cinder_backend = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] image_upload_use_internal_tenant = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] image_volume_cache_enabled     = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] image_volume_cache_max_count   = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] image_volume_cache_max_size_gb = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] init_host_max_objects_retrieval = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] instance_format                = [instance: %(uuid)s]  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] iscsi_target_flags             =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] iscsi_write_cache              = on {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] iser_helper                    = tgtadm {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82470]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] iser_ip_address                = 192.168.122.50 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] iser_port                      = 3260 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] log_color                      = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] log_config_append              = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] log_dir                        = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] log_file                       = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] log_options                    = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] log_rotate_interval            = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] log_rotate_interval_type       = days {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] log_rotation_type              = none {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] max_age                        = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] max_logfile_count              = 30 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] max_logfile_size_mb            = 200 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] max_over_subscription_ratio    = 20.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] message_reap_interval          = 86400 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] message_ttl                    = 2592000 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] migration_create_volume_timeout_secs = 300 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] monkey_patch                   = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] monkey_patch_modules           = [] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] my_ip                          = 192.168.122.50 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] no_snapshot_gb_quota           = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] num_iser_scan_tries            = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] num_shell_tries                = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] num_volume_device_scan_tries   = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] nvmeof_conn_info_version       = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] nvmet_ns_id                    = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] nvmet_port_id                  = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] osapi_max_limit                = 1000 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] osapi_volume_ext_list          = [] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] osapi_volume_listen_port       = 8776 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] osapi_volume_use_ssl           = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] osapi_volume_workers           = 2 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] per_volume_size_limit          = -1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] periodic_fuzzy_delay           = 60 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] periodic_interval              = 60 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] public_endpoint                = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] publish_errors                 = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] quota_backup_gigabytes         = 1000 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] quota_backups                  = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] quota_gigabytes                = 1000 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] quota_groups                   = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] quota_snapshots                = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] quota_volumes                  = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] rate_limit_burst               = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] rate_limit_except_level        = CRITICAL {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] rate_limit_interval            = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] reinit_driver_count            = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] replication_device             = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] report_discard_supported       = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] report_interval                = 120 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] reservation_clean_interval     = 86400 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] reservation_expire             = 86400 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] reserved_image_namespaces      = [] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] reserved_percentage            = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] rpc_response_timeout           = 120 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] run_external_periodic_tasks    = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] scst_target_driver             = iscsi {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] scst_target_iqn_name           = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_down_time              = 720 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] shell_completion               = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] snapshot_name_template         = snapshot-%s {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] split_loggers                  = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] state_path                     = /opt/stack/data/cinder {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] storage_availability_zone      = nova {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] storage_protocol               = iSCSI {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] syslog_log_facility            = LOG_USER {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] target_helper                  = lioadm {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] target_ip_address              = 192.168.122.50 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] target_port                    = 3260 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] target_protocol                = iscsi {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] target_secondary_ip_addresses  = [] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] trace_flags                    = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] transport_url                  = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] until_refresh                  = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] use_chap_auth                  = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] use_default_quota_class        = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] use_journal                    = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] use_json                       = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] use_multipath_for_image_xfer   = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] use_stderr                     = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] use_syslog                     = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] verify_glance_signatures       = enabled {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_api_class               = cinder.volume.api.API {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_backend_name            = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_clear                   = zero {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_clear_ionice            = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_clear_size              = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_copy_bps_limit          = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_dd_blocksize            = 1M {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_name_template           = volume-%s {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_service_inithost_offload = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volume_usage_audit_period      = month {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] zoning_mode                    = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_concurrency.disable_process_locking = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.admin_password = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.admin_token = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.admin_user  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.auth_port   = 35357 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.auth_protocol = https {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.auth_section = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.auth_type   = password {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.auth_uri    = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.auth_version = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.cache       = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.certfile    = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.delay_auth_decision = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.http_connect_timeout = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.identity_uri = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.include_service_catalog = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.insecure    = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.interface   = public {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.keyfile     = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_password =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcache_username =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.region_name = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.service_token_roles_required = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.service_type = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.token_cache_time = 300 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.backend                  = dogpile.cache.null {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.backend_argument         = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.backend_expiration_time  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.config_prefix            = cache.oslo {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.debug_cache_backend      = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.enable_retry_client      = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.enable_socket_keepalive  = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.enabled                  = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.enforce_fips_mode        = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.expiration_time          = 600 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.hashclient_retry_attempts = 2 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.memcache_dead_retry      = 300 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.memcache_pool_maxsize    = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.memcache_sasl_enabled    = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.password                 = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.proxies                  = [] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.redis_db                 = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.redis_sentinel_service_name = mymaster {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.redis_server             = localhost:6379 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.retry_attempts           = 2 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.retry_delay              = 0.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.socket_keepalive_count   = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.socket_keepalive_idle    = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.socket_keepalive_interval = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.socket_timeout           = 1.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.tls_allowed_ciphers      = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.tls_cafile               = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.tls_certfile             = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.tls_enabled              = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.tls_keyfile              = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cache.username                 = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] coordination.backend_url       = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.asyncio_connection    = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.asyncio_slave_connection = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.backend               = sqlalchemy {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.connection            = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.connection_debug      = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.connection_parameters =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.connection_recycle_time = 3600 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.connection_trace      = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.db_inc_retry_interval = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.db_max_retries        = 20 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.db_max_retry_interval = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.db_retry_interval     = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.max_overflow          = 50 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.max_pool_size         = 5 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.max_retries           = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.mysql_wsrep_sync_wait = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.pool_timeout          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.retry_interval        = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.slave_connection      = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.sqlite_synchronous    = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.synchronous_reader    = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] database.use_db_reconnect      = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Starting volume driver QuobyteDriver (1.1.14)
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.connection_string     = messaging:// {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.enabled               = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.es_doc_type           = notification {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.es_scroll_size        = 10000 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.es_scroll_time        = 2m {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.filter_error_trace    = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.hmac_keys             = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.sentinel_service_name = mymaster {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.socket_timeout        = 0.1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.trace_requests        = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler.trace_sqlalchemy      = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82470) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler_jaeger.process_tags   = {} {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler_jaeger.service_name_prefix = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] profiler_otlp.service_name_prefix = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.enforce_new_defaults = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: WARNING oslo_config.cfg [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.enforce_scope      = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.policy_default_rule = default {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.policy_file        = policy.yaml {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] privsep_osbrick.group          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] privsep_osbrick.helper_command = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] privsep_osbrick.user           = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cinder_sys_admin.group         = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cinder_sys_admin.helper_command = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] cinder_sys_admin.user          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_user.auth_section      = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_user.auth_type         = password {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_user.cafile            = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_user.certfile          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_user.collect_timing    = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_user.insecure          = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_user.keyfile           = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_user.send_service_user_token = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_user.split_loggers     = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] service_user.timeout           = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance.auth_section            = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance.auth_type               = password {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance.certfile                = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance.collect_timing          = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance.insecure                = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance.keyfile                 = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance.region_name             = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance.split_loggers           = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] glance.timeout                 = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.backend_availability_zone = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.chap_password = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.chap_username =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.disk_geometry = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.driver_client_cert = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.driver_client_cert_key = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.driver_data_namespace = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.driver_use_ssl = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.enable_unsupported_driver = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.extra_capabilities = {} {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.filter_function = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.goodness_function = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.iscsi_target_flags =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.iscsi_write_cache = on {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.iser_helper   = tgtadm {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.iser_port     = 3260 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nas_host      =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nas_login     = admin {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nas_mount_options = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nas_password  = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nas_private_key =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nas_share_path =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.num_shell_tries = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.nvmet_port_id = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.quobyte_client_cfg = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.quobyte_volume_url = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.replication_device = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.report_discard_supported = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.reserved_percentage = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.scst_target_driver = iscsi {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.scst_target_iqn_name = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.storage_protocol = iSCSI {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.target_helper = tgtadm {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.target_port   = 3260 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.target_protocol = iscsi {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.trace_flags   = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.unique_fqdn_network = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.use_chap_auth = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.volume_backend_name = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.volume_clear  = zero {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.volume_clear_ionice = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.volume_clear_size = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_reports.file_event_handler = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_reports.log_dir           = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.backend_availability_zone = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.backend_host         = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.chap_password        = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.chap_username        = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.chiscsi_conf         = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.disk_geometry        = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.driver_client_cert   = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.driver_client_cert_key = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.driver_data_namespace = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.driver_use_ssl       = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.extra_capabilities   = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.filter_function      = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.goodness_function    = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.iser_helper          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.iser_ip_address      = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.iser_port            = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.iser_target_prefix   = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nas_host             = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nas_login            = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nas_mount_options    = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nas_password         = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nas_private_key      = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nas_share_path       = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nas_ssh_port         = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.num_shell_tries      = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.nvmet_port_id        = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.replication_device   = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.report_discard_supported = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.reserved_percentage  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.scst_target_driver   = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.storage_protocol     = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.target_helper        = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.target_ip_address    = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.target_port          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.target_prefix        = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.target_protocol      = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.trace_flags          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.use_chap_auth        = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.volume_clear         = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.volume_clear_size    = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] QuobyteHD.volumes_dir          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.ssl      = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_notifications.driver = [] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_notifications.retry = -1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] oslo_messaging_notifications.transport_url = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] key_manager.fixed_key          = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.barbican_api_version  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.barbican_endpoint     = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.barbican_endpoint_type = public {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82470) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Feb 28 01:20:28 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.quobyte [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.barbican_region_name  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.cafile                = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.certfile              = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.collect_timing        = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.insecure              = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.keyfile               = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.quobyte [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.number_of_retries     = 60 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.retry_delay           = 1 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.send_service_user_token = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.split_loggers         = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.timeout               = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.verify_ssl            = True {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican.verify_ssl_path       = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican_service_user.auth_section = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican_service_user.auth_type = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican_service_user.cafile   = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican_service_user.certfile = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican_service_user.collect_timing = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican_service_user.insecure = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican_service_user.keyfile  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican_service_user.split_loggers = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] barbican_service_user.timeout  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.approle_role_id          = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.approle_secret_id        = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Running cmd (subprocess): mount.quobyte {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.kv_mountpoint            = secret {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.kv_path                  = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.kv_version               = 2 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.namespace                = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.root_token_id            = **** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.ssl_ca_crt_file          = None {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.timeout                  = 60.0 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.use_ssl                  = False {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 28 01:20:28 devstack cinder-volume[82323]: DEBUG oslo_service.backend._eventlet.service [None req-783b2a01-a23e-48c0-9f83-91f205ce655a None None] ******************************************************************************** {{(pid=82323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 28 01:20:28 devstack quobyte-client[82486]: Reading configuration file: /etc/quobyte/client.cfg
Feb 28 01:20:28 devstack quobyte-client[82486]: Invalid parameters found, error: missing mount point.
Feb 28 01:20:28 devstack quobyte-client[82486]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Feb 28 01:20:28 devstack quobyte-client[82486]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Feb 28 01:20:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:20:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:20:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:20:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:20:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:20:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:20:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:20:28 devstack sudo[82508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:20:28 devstack sudo[82508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:20:29 devstack sudo[82508]: pam_unix(sudo:session): session closed for user root
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.410s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:20:29 devstack cinder-volume[82470]: INFO cinder.volume.driver [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Driver hasn't implemented _init_vendor_properties()
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG cinder.volume.driver [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580757141113, 'free_capacity_gb': 1775.7580757141113, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82470) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_db.sqlalchemy.engines [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writer thread running {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG cinder.db.sqlalchemy.api [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Building query based on filter {{(pid=82470) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82470) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:20:29 devstack cinder-volume[82470]: INFO cinder.keymgr.migration [None req-5d93542c-b1ae-4bc7-9d34-aa0c9b5a871a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 28 01:20:29 devstack sudo[82540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:20:29 devstack sudo[82540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:20:29 devstack sudo[82540]: pam_unix(sudo:session): session closed for user root
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.429s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:20:29 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Driver initialization completed successfully.
Feb 28 01:20:29 devstack cinder-volume[82470]: INFO cinder.manager [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Initiating service 3 cleanup
Feb 28 01:20:29 devstack cinder-volume[82470]: INFO cinder.manager [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Service 3 cleanup completed.
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG cinder.service [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Creating RPC server for service cinder-volume {{(pid=82470) start /opt/stack/cinder/cinder/service.py:231}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG cinder.service [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82470) start /opt/stack/cinder/cinder/service.py:237}}
Feb 28 01:20:29 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:20:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:20:29 devstack sudo[82566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:20:29 devstack sudo[82566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:20:30 devstack sudo[82566]: pam_unix(sudo:session): session closed for user root
Feb 28 01:20:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.376s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:20:30 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-67dfd5a8-9329-4a12-bfbe-7eae9738fd1a None None] Driver post RPC initialization completed successfully.
Feb 28 01:20:38 devstack cinder-volume[82323]: DEBUG dbcounter [-] [82323] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82323) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:20:39 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:20:40 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=3 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:21:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-369d1ebe-9c41-4b61-ba67-aff60f6dfb57 tempest-GroupsTest-818089183 None] Group tempest-Group1-782185152: creating
Feb 28 01:21:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-369d1ebe-9c41-4b61-ba67-aff60f6dfb57 tempest-GroupsTest-818089183 None] Group tempest-Group1-782185152: created successfully
Feb 28 01:21:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-369d1ebe-9c41-4b61-ba67-aff60f6dfb57 tempest-GroupsTest-818089183 None] Create group completed successfully.
Feb 28 01:21:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-9ac73826-3c12-4ae2-81cc-b5264fdd8e4e tempest-GroupsTest-818089183 None] Group tempest-Group2-1428468967: creating
Feb 28 01:21:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-9ac73826-3c12-4ae2-81cc-b5264fdd8e4e tempest-GroupsTest-818089183 None] Group tempest-Group2-1428468967: created successfully
Feb 28 01:21:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-9ac73826-3c12-4ae2-81cc-b5264fdd8e4e tempest-GroupsTest-818089183 None] Create group completed successfully.
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Flow 'volume_create_manager' (da066aa3-ec77-4162-8856-7281773d0d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb3f4fb-2561-4df0-a5ba-fc60cc55cb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb3f4fb-2561-4df0-a5ba-fc60cc55cb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1199467216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0c9b54ba-947d-4a09-be6f-b2033cc591f1,host='devstack@QuobyteHD#QuobyteHD',id=d1324de6-54ae-4980-a14f-48fe69a1e0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9602582e7d014087890b84e21e3c79bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:21:28Z,use_quota=True,user_id='0218c59aa52f42f3915d6571fb76f929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(595f70d8-1eb5-4a4f-bb4f-ad1e63da03bd),volume_type_id=595f70d8-1eb5-4a4f-bb4f-ad1e63da03bd)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a83db49-2581-40bd-9333-075d7f6ce9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a83db49-2581-40bd-9333-075d7f6ce9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cb211e-c9a0-46a1-862e-4f0825b5907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cb211e-c9a0-46a1-862e-4f0825b5907c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1324de6-54ae-4980-a14f-48fe69a1e0db', 'volume_name': 'volume-d1324de6-54ae-4980-a14f-48fe69a1e0db', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e77b53-9a82-47b8-80c3-770e60133fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e77b53-9a82-47b8-80c3-770e60133fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990fb40e-0e58-4d61-816e-15db57f2e82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:28 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Volume d1324de6-54ae-4980-a14f-48fe69a1e0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1324de6-54ae-4980-a14f-48fe69a1e0db', 'volume_size': 1}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0c9b54ba-947d-4a09-be6f-b2033cc591f1,created_at=2026-02-28T00:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1199467216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0c9b54ba-947d-4a09-be6f-b2033cc591f1,host='devstack@QuobyteHD#QuobyteHD',id=d1324de6-54ae-4980-a14f-48fe69a1e0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9602582e7d014087890b84e21e3c79bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:21:28Z,use_quota=True,user_id='0218c59aa52f42f3915d6571fb76f929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(595f70d8-1eb5-4a4f-bb4f-ad1e63da03bd),volume_type_id=595f70d8-1eb5-4a4f-bb4f-ad1e63da03bd)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Creating volume d1324de6-54ae-4980-a14f-48fe69a1e0db {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:21:28 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:21:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:28 devstack sudo[82852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db 1073741824
Feb 28 01:21:28 devstack sudo[82852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:29 devstack sudo[82852]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db 1073741824" returned: 0 in 0.986s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:29 devstack sudo[83170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db
Feb 28 01:21:29 devstack sudo[83170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Flow 'volume_create_manager' (10765540-d52d-441b-bc92-0cd55ee13e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddacfecf-0285-4f97-bfeb-88f49c02b1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddacfecf-0285-4f97-bfeb-88f49c02b1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1310242787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6754026-98f7-4fc1-a7c9-31bbbf65b0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9334e9af7cff4fa094aa989fcad935d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:21:29Z,use_quota=True,user_id='cb88f5fc22014a52b79cf86c8e4acbcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57423fae-a7e8-47c6-998c-f2dbab255529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57423fae-a7e8-47c6-998c-f2dbab255529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24633ee-bff5-4cd7-8656-6b8ab3ffe2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24633ee-bff5-4cd7-8656-6b8ab3ffe2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6754026-98f7-4fc1-a7c9-31bbbf65b0d4', 'volume_name': 'volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c8ec37-cf5a-4afb-9607-285961117cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c8ec37-cf5a-4afb-9607-285961117cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f284857-541b-4751-9e2e-602cd5f2ffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:29 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Volume d6754026-98f7-4fc1-a7c9-31bbbf65b0d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4', 'volume_size': 1}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:29 devstack sudo[83170]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db" returned: 0 in 0.700s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:21:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1310242787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6754026-98f7-4fc1-a7c9-31bbbf65b0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9334e9af7cff4fa094aa989fcad935d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:21:29Z,use_quota=True,user_id='cb88f5fc22014a52b79cf86c8e4acbcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Creating volume d6754026-98f7-4fc1-a7c9-31bbbf65b0d4 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:21:30 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990fb40e-0e58-4d61-816e-15db57f2e82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1324de6-54ae-4980-a14f-48fe69a1e0db', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f06fda1-b130-4bf0-aa7d-9d80382e228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:30 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Volume volume-d1324de6-54ae-4980-a14f-48fe69a1e0db (d1324de6-54ae-4980-a14f-48fe69a1e0db): created successfully
Feb 28 01:21:30 devstack sudo[83173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4 1073741824
Feb 28 01:21:30 devstack sudo[83173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f06fda1-b130-4bf0-aa7d-9d80382e228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Flow 'volume_create_manager' (da066aa3-ec77-4162-8856-7281773d0d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:21:30 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d0ef0da6-8725-4f37-9d27-6d801bcb849d tempest-GroupsTest-818089183 None] Created volume successfully.
Feb 28 01:21:30 devstack sudo[83173]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4 1073741824" returned: 0 in 0.985s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:31 devstack sudo[83181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4
Feb 28 01:21:31 devstack sudo[83181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Acquiring lock "cinder-quobyte-d1324de6-54ae-4980-a14f-48fe69a1e0db" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:21:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Lock "cinder-quobyte-d1324de6-54ae-4980-a14f-48fe69a1e0db" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:21:31 devstack cinder-volume[82470]: INFO oslo.privsep.daemon [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdnhynio1/privsep.sock']
Feb 28 01:21:31 devstack sudo[83183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdnhynio1/privsep.sock
Feb 28 01:21:31 devstack sudo[83183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:31 devstack sudo[83181]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4" returned: 0 in 0.477s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:21:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f284857-541b-4751-9e2e-602cd5f2ffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9339f8b1-85a7-4062-8bc6-d84a7870144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:31 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Volume volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4 (d6754026-98f7-4fc1-a7c9-31bbbf65b0d4): created successfully
Feb 28 01:21:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9339f8b1-85a7-4062-8bc6-d84a7870144d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Flow 'volume_create_manager' (10765540-d52d-441b-bc92-0cd55ee13e1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:21:31 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e327f160-941a-462f-9330-ce9ed8e5d5f7 tempest-DeleteServersTestJSON-1275723946 None] Created volume successfully.
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Flow 'volume_create_manager' (b8d903c5-b81b-44e5-9565-cf1a70505ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafd3cae-497a-4605-9b1f-d1664e4fb8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafd3cae-497a-4605-9b1f-d1664e4fb8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1675286097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8735584-87b5-4bcb-88e5-6e97d9e3d753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59962c1c8ffd449da80085efc4552ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:21:32Z,use_quota=True,user_id='541d794a4d914dd0b6abb8c61836848b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de6848a-b54a-4bc5-b5ec-f7291ee55886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de6848a-b54a-4bc5-b5ec-f7291ee55886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21953e5a-edda-4da2-a297-6c75b1eb84f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21953e5a-edda-4da2-a297-6c75b1eb84f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8735584-87b5-4bcb-88e5-6e97d9e3d753', 'volume_name': 'volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8effe4-b992-415f-83b7-1e8b677474ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8effe4-b992-415f-83b7-1e8b677474ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9487dcad-f654-47f0-bc75-6238a329e8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:32 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Volume a8735584-87b5-4bcb-88e5-6e97d9e3d753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753', 'volume_size': 1}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1675286097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8735584-87b5-4bcb-88e5-6e97d9e3d753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59962c1c8ffd449da80085efc4552ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:21:32Z,use_quota=True,user_id='541d794a4d914dd0b6abb8c61836848b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Creating volume a8735584-87b5-4bcb-88e5-6e97d9e3d753 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:21:32 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:32 devstack sudo[83188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753 1073741824
Feb 28 01:21:32 devstack sudo[83188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:32 devstack sudo[83183]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:32 devstack cinder-volume[82470]: INFO oslo.privsep.daemon [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Spawned new privsep daemon via rootwrap
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Accepted privsep connection to /tmp/tmpdnhynio1/privsep.sock {{(pid=82470) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Feb 28 01:21:32 devstack cinder-volume[82470]: INFO oslo.privsep.daemon [-] privsep daemon starting
Feb 28 01:21:32 devstack cinder-volume[82470]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Feb 28 01:21:32 devstack cinder-volume[82470]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Feb 28 01:21:32 devstack cinder-volume[82470]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83189
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0034da9-8d5a-4f0a-974b-5421746f3774]: (2,) {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6d3418-4b55-44a7-8471-bbc5dc583bcb]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:21:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:32 devstack sudo[83192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db
Feb 28 01:21:32 devstack sudo[83192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:33 devstack sudo[83188]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753 1073741824" returned: 0 in 0.747s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:33 devstack sudo[83200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753
Feb 28 01:21:33 devstack sudo[83200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:33 devstack sudo[83192]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db" returned: 0 in 0.595s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:33 devstack sudo[83203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db
Feb 28 01:21:33 devstack sudo[83203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:33 devstack sudo[83200]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753" returned: 0 in 0.507s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9487dcad-f654-47f0-bc75-6238a329e8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23de42a7-b4b1-4a8a-8858-65956c190373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:33 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Volume volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753 (a8735584-87b5-4bcb-88e5-6e97d9e3d753): created successfully
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23de42a7-b4b1-4a8a-8858-65956c190373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Flow 'volume_create_manager' (b8d903c5-b81b-44e5-9565-cf1a70505ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:21:33 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-032c20ea-700f-4c6f-a8bf-3a8179909975 tempest-VolumesAdminNegativeTest-738105896 None] Created volume successfully.
Feb 28 01:21:33 devstack sudo[83203]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1324de6-54ae-4980-a14f-48fe69a1e0db" returned: 0 in 0.575s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Lock "cinder-quobyte-d1324de6-54ae-4980-a14f-48fe69a1e0db" released by "delete_volume" :: held 2.561s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Created reservations ['987800bf-8713-401e-a1e1-d3aa7cc4d55f'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:21:33 devstack cinder-volume[82470]: WARNING cinder.quota [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1869722245 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1869722245, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:21:33 devstack cinder-volume[82470]: WARNING cinder.quota [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1869722245 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1869722245, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Created reservations ['ab2dc241-b930-43c6-892c-11f66930a6be', '720fbc20-66d1-4af5-86c2-5b2b4f0186f4', 'bfb860f5-d09d-41ac-bec4-33625cc86fab', '6c84d247-48e2-4c8b-9736-d5d90b714311'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:33 devstack sudo[83207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:21:33 devstack sudo[83207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:34 devstack sudo[83207]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.472s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:21:34 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-0d81a55c-3c28-4249-a95c-ab5d6d05f0a9 tempest-GroupsTest-818089183 None] Delete group completed successfully.
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Acquiring lock "cinder-a8735584-87b5-4bcb-88e5-6e97d9e3d753-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Lock "cinder-a8735584-87b5-4bcb-88e5-6e97d9e3d753-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Acquiring lock "cinder-quobyte-a8735584-87b5-4bcb-88e5-6e97d9e3d753" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-1c89930b-3d7a-486f-9e6e-973e1c490a78 tempest-GroupsTest-818089183 None] Created reservations ['928b4df6-1fac-4d60-af3d-8e3a910994bf'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Lock "cinder-quobyte-a8735584-87b5-4bcb-88e5-6e97d9e3d753" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d4487-10b1-4e38-854d-dccdd622e787]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1c89930b-3d7a-486f-9e6e-973e1c490a78 tempest-GroupsTest-818089183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1c89930b-3d7a-486f-9e6e-973e1c490a78 tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1c89930b-3d7a-486f-9e6e-973e1c490a78 tempest-GroupsTest-818089183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1c89930b-3d7a-486f-9e6e-973e1c490a78 tempest-GroupsTest-818089183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1c89930b-3d7a-486f-9e6e-973e1c490a78 tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1c89930b-3d7a-486f-9e6e-973e1c490a78 tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:34 devstack sudo[83212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:21:34 devstack sudo[83212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:34 devstack sudo[83211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753
Feb 28 01:21:34 devstack sudo[83211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:35 devstack sudo[83212]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1c89930b-3d7a-486f-9e6e-973e1c490a78 tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.709s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:35 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-1c89930b-3d7a-486f-9e6e-973e1c490a78 tempest-GroupsTest-818089183 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:21:35 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1c89930b-3d7a-486f-9e6e-973e1c490a78 tempest-GroupsTest-818089183 None] Delete group completed successfully.
Feb 28 01:21:35 devstack sudo[83211]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753" returned: 0 in 0.882s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:35 devstack sudo[83219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753
Feb 28 01:21:35 devstack sudo[83219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:36 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-238f0c9b-6574-45ba-8eab-a2f9545eb7c1 tempest-GroupsTest-818089183 None] Group tempest-GroupsTest-Group-1842133750: creating
Feb 28 01:21:36 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-238f0c9b-6574-45ba-8eab-a2f9545eb7c1 tempest-GroupsTest-818089183 None] Group tempest-GroupsTest-Group-1842133750: created successfully
Feb 28 01:21:36 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-238f0c9b-6574-45ba-8eab-a2f9545eb7c1 tempest-GroupsTest-818089183 None] Create group completed successfully.
Feb 28 01:21:37 devstack sudo[83219]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8735584-87b5-4bcb-88e5-6e97d9e3d753" returned: 0 in 1.593s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Lock "cinder-quobyte-a8735584-87b5-4bcb-88e5-6e97d9e3d753" released by "delete_volume" :: held 2.545s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:21:37 devstack cinder-volume[82470]: WARNING cinder.quota [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:21:37 devstack cinder-volume[82470]: WARNING cinder.quota [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:21:37 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Created reservations ['e30fd016-0094-4ddd-bff1-2b56e633bc9e', 'd30a1b41-42fe-4be4-9321-37ae132c5827', '8524fab0-cfe8-4113-b6ed-bd9213132749', 'c03a8612-abd6-4cc2-8079-c27df2b8ad14'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:21:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:37 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:37 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:37 devstack sudo[83261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:21:37 devstack sudo[83261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Flow 'volume_create_manager' (de5da8a3-d312-46ac-aa71-acda19ebe6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:21:38 devstack sudo[83261]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd09450-cc23-4840-82f6-cd3f0f926ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 1.361s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:21:38 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Deleted volume successfully.
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd09450-cc23-4840-82f6-cd3f0f926ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847337941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9af281b0-357c-4a6c-92a5-95abb1258446,host='devstack@QuobyteHD#QuobyteHD',id=c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9602582e7d014087890b84e21e3c79bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:21:39Z,use_quota=True,user_id='0218c59aa52f42f3915d6571fb76f929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecce3c14-dc56-47be-9dbb-08ebcebb61f7),volume_type_id=ecce3c14-dc56-47be-9dbb-08ebcebb61f7)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9434003f-1a68-4563-a039-71698d34b025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9434003f-1a68-4563-a039-71698d34b025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a0b234-8298-4107-a1b6-3092d2df32e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a0b234-8298-4107-a1b6-3092d2df32e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d', 'volume_name': 'volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef605a07-c565-4286-a66d-a77036a07221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef605a07-c565-4286-a66d-a77036a07221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3f2c86-30b3-46d4-a2f3-1aa9407e9f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:38 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Volume c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d', 'volume_size': 1}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9af281b0-357c-4a6c-92a5-95abb1258446,created_at=2026-02-28T00:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847337941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9af281b0-357c-4a6c-92a5-95abb1258446,host='devstack@QuobyteHD#QuobyteHD',id=c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9602582e7d014087890b84e21e3c79bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:21:39Z,use_quota=True,user_id='0218c59aa52f42f3915d6571fb76f929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecce3c14-dc56-47be-9dbb-08ebcebb61f7),volume_type_id=ecce3c14-dc56-47be-9dbb-08ebcebb61f7)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Creating volume c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:21:38 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c13cd918-ddde-4379-9d68-a50b9f6f146a tempest-VolumesAdminNegativeTest-738105896 None] Lock "cinder-a8735584-87b5-4bcb-88e5-6e97d9e3d753-delete_volume" released by "delete_volume" :: held 4.312s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:21:38 devstack sudo[83279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d 1073741824
Feb 28 01:21:38 devstack sudo[83279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:39 devstack sudo[83279]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d 1073741824" returned: 0 in 0.988s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:39 devstack cinder-volume[82470]: WARNING py.warnings [req-5d9f460c-c448-4f4a-bbfb-648b3c12c8b1 req-3e96121c-4f90-4749-ac18-142ca79a00b5 tempest-DeleteServersTestJSON-1275723946 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Feb 28 01:21:39 devstack cinder-volume[82470]:   .first()
Feb 28 01:21:39 devstack cinder-volume[82470]: 
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-5d9f460c-c448-4f4a-bbfb-648b3c12c8b1 req-3e96121c-4f90-4749-ac18-142ca79a00b5 tempest-DeleteServersTestJSON-1275723946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:40 devstack sudo[83327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d
Feb 28 01:21:40 devstack sudo[83327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:40 devstack sudo[83327]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d" returned: 0 in 0.587s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-5d9f460c-c448-4f4a-bbfb-648b3c12c8b1 req-3e96121c-4f90-4749-ac18-142ca79a00b5 tempest-DeleteServersTestJSON-1275723946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.600s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3f2c86-30b3-46d4-a2f3-1aa9407e9f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ba4f17-c2b5-4f27-b9ae-dbf61e37ae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb8e02e-aa78-4077-a248-31bea6dc3e52]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-5d9f460c-c448-4f4a-bbfb-648b3c12c8b1 req-3e96121c-4f90-4749-ac18-142ca79a00b5 tempest-DeleteServersTestJSON-1275723946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:40 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Volume volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d (c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d): created successfully
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ba4f17-c2b5-4f27-b9ae-dbf61e37ae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Flow 'volume_create_manager' (de5da8a3-d312-46ac-aa71-acda19ebe6db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:21:40 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-00307819-a756-4b32-93ea-3e788c84016c tempest-GroupsTest-818089183 None] Created volume successfully.
Feb 28 01:21:40 devstack sudo[83332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4
Feb 28 01:21:40 devstack sudo[83332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Flow 'volume_create_manager' (9f12bfcb-3669-4321-bf07-1a44e906dd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60806a86-ddbd-46fb-9166-420ebea69144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60806a86-ddbd-46fb-9166-420ebea69144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202247086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9af281b0-357c-4a6c-92a5-95abb1258446,host='devstack@QuobyteHD#QuobyteHD',id=ce56293d-d027-42d2-8d7f-8020dd137dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9602582e7d014087890b84e21e3c79bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:21:41Z,use_quota=True,user_id='0218c59aa52f42f3915d6571fb76f929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecce3c14-dc56-47be-9dbb-08ebcebb61f7),volume_type_id=ecce3c14-dc56-47be-9dbb-08ebcebb61f7)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe1e0e5-07e4-4a81-86c7-b28b0f266ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe1e0e5-07e4-4a81-86c7-b28b0f266ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef65f01-2342-4b58-b907-7c73557ca501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef65f01-2342-4b58-b907-7c73557ca501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce56293d-d027-42d2-8d7f-8020dd137dea', 'volume_name': 'volume-ce56293d-d027-42d2-8d7f-8020dd137dea', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3d2294-d62d-4750-9ab6-66f56b70626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3d2294-d62d-4750-9ab6-66f56b70626d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6119037-3f28-46b4-8720-80d4eb89477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:41 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Volume ce56293d-d027-42d2-8d7f-8020dd137dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce56293d-d027-42d2-8d7f-8020dd137dea', 'volume_size': 1}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:41 devstack sudo[83332]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-5d9f460c-c448-4f4a-bbfb-648b3c12c8b1 req-3e96121c-4f90-4749-ac18-142ca79a00b5 tempest-DeleteServersTestJSON-1275723946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4" returned: 0 in 0.692s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-5d9f460c-c448-4f4a-bbfb-648b3c12c8b1 req-3e96121c-4f90-4749-ac18-142ca79a00b5 tempest-DeleteServersTestJSON-1275723946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.708s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9af281b0-357c-4a6c-92a5-95abb1258446,created_at=2026-02-28T00:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202247086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9af281b0-357c-4a6c-92a5-95abb1258446,host='devstack@QuobyteHD#QuobyteHD',id=ce56293d-d027-42d2-8d7f-8020dd137dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9602582e7d014087890b84e21e3c79bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:21:41Z,use_quota=True,user_id='0218c59aa52f42f3915d6571fb76f929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecce3c14-dc56-47be-9dbb-08ebcebb61f7),volume_type_id=ecce3c14-dc56-47be-9dbb-08ebcebb61f7)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Creating volume ce56293d-d027-42d2-8d7f-8020dd137dea {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:21:41 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:41 devstack sudo[83337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea 1073741824
Feb 28 01:21:41 devstack sudo[83337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-5d9f460c-c448-4f4a-bbfb-648b3c12c8b1 req-3e96121c-4f90-4749-ac18-142ca79a00b5 tempest-DeleteServersTestJSON-1275723946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc', 'name': 'volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2fbca9a-e1b7-4553-ac10-bf396f0e51a2', 'enforce_multipath': True} {{(pid=82470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 28 01:21:41 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-5d9f460c-c448-4f4a-bbfb-648b3c12c8b1 req-3e96121c-4f90-4749-ac18-142ca79a00b5 tempest-DeleteServersTestJSON-1275723946 None] attachment_update completed successfully.
Feb 28 01:21:42 devstack sudo[83337]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea 1073741824" returned: 0 in 0.695s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:42 devstack sudo[83345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea
Feb 28 01:21:42 devstack sudo[83345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:42 devstack sudo[83345]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:21:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6119037-3f28-46b4-8720-80d4eb89477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce56293d-d027-42d2-8d7f-8020dd137dea', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf5ac22-0522-4120-83b0-94ed9b1fefdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:21:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Volume volume-ce56293d-d027-42d2-8d7f-8020dd137dea (ce56293d-d027-42d2-8d7f-8020dd137dea): created successfully
Feb 28 01:21:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf5ac22-0522-4120-83b0-94ed9b1fefdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:21:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Flow 'volume_create_manager' (9f12bfcb-3669-4321-bf07-1a44e906dd4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:21:42 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-12795759-8e70-453b-abc2-e8ef816a91f7 tempest-GroupsTest-818089183 None] Created volume successfully.
Feb 28 01:21:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-13e8ef08-05fd-44ee-a059-ef810d0374a6 tempest-GroupsTest-818089183 None] Update group completed successfully.
Feb 28 01:21:44 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ccfdc65b-aa8a-46f2-8277-89350575ea62 tempest-GroupsTest-818089183 None] Update group completed successfully.
Feb 28 01:21:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Acquiring lock "cinder-quobyte-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:21:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Lock "cinder-quobyte-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:21:46 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cc2779-7e62-4e08-90eb-beb3b7d8e973]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:21:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:46 devstack sudo[83759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d
Feb 28 01:21:46 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:46 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d" returned: 0 in 0.763s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:46 devstack sudo[83764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d
Feb 28 01:21:46 devstack sudo[83764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:47 devstack sudo[83764]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d" returned: 0 in 0.529s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Lock "cinder-quobyte-c138fd41-b5a4-4d1d-83ba-bfba5b06bc2d" released by "delete_volume" :: held 1.331s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:21:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Acquiring lock "cinder-quobyte-ce56293d-d027-42d2-8d7f-8020dd137dea" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:21:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Lock "cinder-quobyte-ce56293d-d027-42d2-8d7f-8020dd137dea" acquired by "delete_volume" :: waited 0.016s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:21:47 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e0f102-341c-437d-a1e6-a5a2e3fe0cbb]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:21:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:47 devstack sudo[83768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea
Feb 28 01:21:47 devstack sudo[83768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:48 devstack sudo[83768]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea" returned: 0 in 1.007s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:48 devstack sudo[83796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea
Feb 28 01:21:48 devstack sudo[83796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:49 devstack sudo[83796]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ce56293d-d027-42d2-8d7f-8020dd137dea" returned: 0 in 0.691s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Lock "cinder-quobyte-ce56293d-d027-42d2-8d7f-8020dd137dea" released by "delete_volume" :: held 1.733s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Created reservations ['7eb0fc76-b1c7-4e74-a004-b7089c221c16'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:21:49 devstack cinder-volume[82470]: WARNING cinder.quota [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-415505044 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-415505044, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:21:49 devstack cinder-volume[82470]: WARNING cinder.quota [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-415505044 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-415505044, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Created reservations ['71c567c5-b7cc-423d-9f54-10be8e2f0fea', '468e6f76-61f1-4772-b690-c4a9ce5eabec', 'f413f2c6-d849-49a4-8653-44fdf344b0f4', '9e27f24e-4133-4e07-a31f-613a17d1b6b7'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Created reservations ['d8410418-3928-4236-b4cc-3a7cc5d0c798', 'aa97f0fd-dc20-4fee-8db1-9f4769c00f29', '8c0913d2-2e43-439f-96e2-d41d5032f18c', 'dd86e618-6548-4f91-ae66-23b6c30a2407'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:49 devstack sudo[83826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:21:49 devstack sudo[83826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:50 devstack sudo[83826]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.737s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:50 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:21:50 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-50c7d9c0-6cec-4224-ba3f-df2b58ea4da5 tempest-GroupsTest-818089183 None] Delete group completed successfully.
Feb 28 01:21:51 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-72e2f709-43b6-4664-b27a-6c4c96edd5bc req-154bcee0-7825-4d5c-8b4d-2c2ff7ea5b27 tempest-DeleteServersTestJSON-1275723946 None] Terminate volume connection completed successfully.
Feb 28 01:21:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-72e2f709-43b6-4664-b27a-6c4c96edd5bc req-154bcee0-7825-4d5c-8b4d-2c2ff7ea5b27 tempest-DeleteServersTestJSON-1275723946 None] Deleting attachment a2fbca9a-e1b7-4553-ac10-bf396f0e51a2. {{(pid=82470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 28 01:21:53 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-df3c5d22-fc71-42ae-90c1-cda294e266b1 tempest-GroupsV320Test-241248255 None] Group tempest-GroupsV320Test-Group-206008424: creating
Feb 28 01:21:53 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-df3c5d22-fc71-42ae-90c1-cda294e266b1 tempest-GroupsV320Test-241248255 None] Group tempest-GroupsV320Test-Group-206008424: created successfully
Feb 28 01:21:53 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-df3c5d22-fc71-42ae-90c1-cda294e266b1 tempest-GroupsV320Test-241248255 None] Create group completed successfully.
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Acquiring lock "cinder-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Lock "cinder-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Acquiring lock "cinder-quobyte-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Lock "cinder-quobyte-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c49f6f-85fc-4dcc-babf-ff8062f09455]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:54 devstack sudo[83861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:21:54 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:54 devstack sudo[83862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4
Feb 28 01:21:54 devstack sudo[83862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:54 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.608s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:54 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:21:55 devstack sudo[83862]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4" returned: 0 in 0.852s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:55 devstack sudo[83869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4
Feb 28 01:21:55 devstack sudo[83869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-d0f797a1-058c-4266-9447-8c59f085312b tempest-GroupsV320Test-241248255 None] Created reservations ['e34cf9bc-dcd4-4607-b9a7-080668e8e59e'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d0f797a1-058c-4266-9447-8c59f085312b tempest-GroupsV320Test-241248255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d0f797a1-058c-4266-9447-8c59f085312b tempest-GroupsV320Test-241248255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d0f797a1-058c-4266-9447-8c59f085312b tempest-GroupsV320Test-241248255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d0f797a1-058c-4266-9447-8c59f085312b tempest-GroupsV320Test-241248255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d0f797a1-058c-4266-9447-8c59f085312b tempest-GroupsV320Test-241248255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d0f797a1-058c-4266-9447-8c59f085312b tempest-GroupsV320Test-241248255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:55 devstack sudo[83871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:21:55 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:55 devstack sudo[83869]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4" returned: 0 in 0.688s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Lock "cinder-quobyte-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4" released by "delete_volume" :: held 1.604s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Created reservations ['b6880067-5ab6-48be-b91b-cc24d5f6b230', 'ea757eef-0e09-4077-9232-cc71abd3e107', '8008c71d-b124-47db-8266-f5cf0922fb9d', '0942970d-1923-4a84-9abd-d0d6daf095c2'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:21:55 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:55 devstack sudo[83876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:21:55 devstack sudo[83876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d0f797a1-058c-4266-9447-8c59f085312b tempest-GroupsV320Test-241248255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.660s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:55 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-d0f797a1-058c-4266-9447-8c59f085312b tempest-GroupsV320Test-241248255 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:21:56 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d0f797a1-058c-4266-9447-8c59f085312b tempest-GroupsV320Test-241248255 None] Delete group completed successfully.
Feb 28 01:21:56 devstack sudo[83876]: pam_unix(sudo:session): session closed for user root
Feb 28 01:21:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.671s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:21:56 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:21:56 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Deleted volume successfully.
Feb 28 01:21:56 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1cb4badf-ae0b-4a58-914c-9c248b33cc97 tempest-DeleteServersTestJSON-1275723946 None] Lock "cinder-d6754026-98f7-4fc1-a7c9-31bbbf65b0d4-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Flow 'volume_create_manager' (f8184381-c69b-4386-9493-54a7baffcf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877f44b7-dfcd-413a-839b-86ffac02dbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877f44b7-dfcd-413a-839b-86ffac02dbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:06Z,deleted=False,deleted_at=None,display_description='',display_name='034cde05-c29f-4144-b213-275ea7b1abf4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cfb912-20fb-40a9-8342-422dbe52d6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687572f3832e47129c072cb436f8164b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:06Z,use_quota=True,user_id='6914c147ffba4dd49eb62db9b3bf3c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16b8977-0d1e-469b-bd39-7bc34c2a3bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16b8977-0d1e-469b-bd39-7bc34c2a3bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0b6a5a-cae7-4b8c-a826-2499e49ea165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0b6a5a-cae7-4b8c-a826-2499e49ea165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7cfb912-20fb-40a9-8342-422dbe52d6ab', 'volume_name': 'volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a291a257-79fa-4a7d-b914-2a3f26259a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a291a257-79fa-4a7d-b914-2a3f26259a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da0775c-a2bd-48a7-9fb9-01b9c9442ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:05 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Volume f7cfb912-20fb-40a9-8342-422dbe52d6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab', 'volume_size': 1}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:06Z,deleted=False,deleted_at=None,display_description='',display_name='034cde05-c29f-4144-b213-275ea7b1abf4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cfb912-20fb-40a9-8342-422dbe52d6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687572f3832e47129c072cb436f8164b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:06Z,use_quota=True,user_id='6914c147ffba4dd49eb62db9b3bf3c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Creating volume f7cfb912-20fb-40a9-8342-422dbe52d6ab {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:22:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:22:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:22:06 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:22:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:06 devstack sudo[83890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab 1073741824
Feb 28 01:22:06 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:06 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab 1073741824" returned: 0 in 0.802s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:06 devstack sudo[83896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab
Feb 28 01:22:06 devstack sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:07 devstack sudo[83896]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab" returned: 0 in 0.645s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:22:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da0775c-a2bd-48a7-9fb9-01b9c9442ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96b74f5-d97f-40bf-b958-3324a9a17ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:07 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Volume volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab (f7cfb912-20fb-40a9-8342-422dbe52d6ab): created successfully
Feb 28 01:22:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96b74f5-d97f-40bf-b958-3324a9a17ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Flow 'volume_create_manager' (f8184381-c69b-4386-9493-54a7baffcf56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:07 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-30ade2e8-fea1-49de-924d-58d94bb044ea tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Created volume successfully.
Feb 28 01:22:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-f4c3fe4f-fcf3-4258-966a-46fcc1fbe719 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-f4c3fe4f-fcf3-4258-966a-46fcc1fbe719 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:09 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c40172a-82f1-4081-b4f6-db7fe429ff7d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:22:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-f4c3fe4f-fcf3-4258-966a-46fcc1fbe719 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:09 devstack sudo[83912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab
Feb 28 01:22:09 devstack sudo[83912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:09 devstack sudo[83912]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-f4c3fe4f-fcf3-4258-966a-46fcc1fbe719 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab" returned: 0 in 0.809s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-f4c3fe4f-fcf3-4258-966a-46fcc1fbe719 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.839s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-f4c3fe4f-fcf3-4258-966a-46fcc1fbe719 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc', 'name': 'volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '115f3e8f-5f6f-4e69-873e-efd63aec6b2d', 'enforce_multipath': True} {{(pid=82470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 28 01:22:10 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-ba446d57-e4b3-43f0-b7d0-1c6a166d08cd req-f4c3fe4f-fcf3-4258-966a-46fcc1fbe719 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] attachment_update completed successfully.
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Flow 'volume_create_manager' (709f7ad0-d164-4c03-b1b4-0895d2cc4933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f3903b-a434-4125-b9e4-846d6849305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f3903b-a434-4125-b9e4-846d6849305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1807507697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2c292aaf0e473bba8ab91d378f31e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:16Z,use_quota=True,user_id='ef17905e4c434a468c9d8aacfb18fd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc799902-861f-44e1-89b3-6de1df5ee33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc799902-861f-44e1-89b3-6de1df5ee33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0434d377-7b65-46a2-be76-1d947bf5369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0434d377-7b65-46a2-be76-1d947bf5369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7', 'volume_name': 'volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2ccb34-96ee-4d30-ab8d-f95ecdaa6439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2ccb34-96ee-4d30-ab8d-f95ecdaa6439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47f7b59-d84c-4b52-8e01-e3ce8dd15a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:15 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Volume 7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7', 'volume_size': 1}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1807507697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2c292aaf0e473bba8ab91d378f31e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:16Z,use_quota=True,user_id='ef17905e4c434a468c9d8aacfb18fd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Creating volume 7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:22:15 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:22:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:15 devstack sudo[83995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7 1073741824
Feb 28 01:22:15 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:16 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7 1073741824" returned: 0 in 0.726s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:16 devstack sudo[84006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7
Feb 28 01:22:16 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:17 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:22:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47f7b59-d84c-4b52-8e01-e3ce8dd15a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5183535f-80e3-4431-8637-8036f7051826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:17 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Volume volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7 (7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7): created successfully
Feb 28 01:22:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5183535f-80e3-4431-8637-8036f7051826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Flow 'volume_create_manager' (709f7ad0-d164-4c03-b1b4-0895d2cc4933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:17 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-468f2745-8868-4317-ac20-ffb938584e4f tempest-VolumeQuotasAdminTestJSON-837028284 None] Created volume successfully.
Feb 28 01:22:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Acquiring lock "cinder-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:22:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "cinder-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:22:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Acquiring lock "cinder-quobyte-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:22:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "cinder-quobyte-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7" acquired by "delete_volume" :: waited 0.028s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:22:18 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd33460-c069-4e4b-babd-c2970aad6037]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:22:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:18 devstack sudo[84346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7
Feb 28 01:22:18 devstack sudo[84346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:19 devstack sudo[84346]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7" returned: 0 in 0.754s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:19 devstack sudo[84357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7
Feb 28 01:22:19 devstack sudo[84357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:19 devstack sudo[84357]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7" returned: 0 in 0.421s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "cinder-quobyte-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7" released by "delete_volume" :: held 1.227s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Created reservations ['db2c0856-c3b9-4337-9790-214c3a120028', '0834ce67-fcfe-4e75-b9f0-d7f7fab1cb4d', '356fd8a4-5ebc-43f6-8c6a-1a2cae8e41b5', '249bd94e-108a-46ed-a02f-3ae840008773'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:19 devstack sudo[84372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:22:19 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:20 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.415s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:22:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Deleted volume successfully.
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=79,cinder:UPDATE=97,cinder:DELETE=8,cinder:INSERT=19 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e8caed2-9efe-4352-8119-7242bb4fe9dd tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "cinder-7c02dfe6-3e3b-42fa-9109-3bdd6fe96db7-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=91,cinder:UPDATE=79,cinder:INSERT=16,cinder:DELETE=2 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Flow 'volume_create_manager' (777b9674-2569-4c87-a3db-a83203594c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b18f92-44cb-413b-a275-a509ac59178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b18f92-44cb-413b-a275-a509ac59178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1426514834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea98a29a-86c8-49e6-a2cf-5ff767505d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2c292aaf0e473bba8ab91d378f31e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:21Z,use_quota=True,user_id='ef17905e4c434a468c9d8aacfb18fd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacd56f5-a9b4-433c-b757-47877ae8fc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacd56f5-a9b4-433c-b757-47877ae8fc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdaf9e3e-8856-4b09-812d-2cc04ebb4893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdaf9e3e-8856-4b09-812d-2cc04ebb4893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea98a29a-86c8-49e6-a2cf-5ff767505d31', 'volume_name': 'volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333e666f-3d78-4d7d-b677-1d9f3d1a445d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333e666f-3d78-4d7d-b677-1d9f3d1a445d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf256c7d-5b20-491d-9ea7-67a430e94afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:20 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Volume ea98a29a-86c8-49e6-a2cf-5ff767505d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31', 'volume_size': 1}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1426514834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea98a29a-86c8-49e6-a2cf-5ff767505d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2c292aaf0e473bba8ab91d378f31e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:21Z,use_quota=True,user_id='ef17905e4c434a468c9d8aacfb18fd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Creating volume ea98a29a-86c8-49e6-a2cf-5ff767505d31 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:22:20 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:22:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:20 devstack sudo[84376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31 1073741824
Feb 28 01:22:20 devstack sudo[84376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:21 devstack sudo[84376]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31 1073741824" returned: 0 in 0.662s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:21 devstack sudo[84381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31
Feb 28 01:22:21 devstack sudo[84381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:22 devstack sudo[84381]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31" returned: 0 in 0.480s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:22:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf256c7d-5b20-491d-9ea7-67a430e94afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08a813f-2a39-4169-ab71-6cd9fb5253d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:22 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Volume volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31 (ea98a29a-86c8-49e6-a2cf-5ff767505d31): created successfully
Feb 28 01:22:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08a813f-2a39-4169-ab71-6cd9fb5253d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Flow 'volume_create_manager' (777b9674-2569-4c87-a3db-a83203594c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:22 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-cecaa5d5-7ee7-444c-b5bb-47368f4ad414 tempest-VolumeQuotasAdminTestJSON-837028284 None] Created volume successfully.
Feb 28 01:22:23 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-f117116a-04b1-4197-af49-773fa5ad6e10 tempest-VolumeQuotasAdminTestJSON-1101482239 None] Transfer volume completed successfully.
Feb 28 01:22:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Acquiring lock "cinder-ea98a29a-86c8-49e6-a2cf-5ff767505d31-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:22:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Lock "cinder-ea98a29a-86c8-49e6-a2cf-5ff767505d31-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:22:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Acquiring lock "cinder-quobyte-ea98a29a-86c8-49e6-a2cf-5ff767505d31" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:22:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Lock "cinder-quobyte-ea98a29a-86c8-49e6-a2cf-5ff767505d31" acquired by "delete_volume" :: waited 0.027s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:22:24 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f8106e-a1d8-42d0-b9d8-e8a94837e07e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:22:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:24 devstack sudo[84433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31
Feb 28 01:22:24 devstack sudo[84433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:25 devstack sudo[84433]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31" returned: 0 in 1.245s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:25 devstack sudo[84454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31
Feb 28 01:22:25 devstack sudo[84454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:26 devstack sudo[84454]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea98a29a-86c8-49e6-a2cf-5ff767505d31" returned: 0 in 0.530s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Lock "cinder-quobyte-ea98a29a-86c8-49e6-a2cf-5ff767505d31" released by "delete_volume" :: held 1.818s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Created reservations ['7d6b767c-6c2c-491e-8b3e-c3410f12e253', '5527d74d-3b1f-431e-ba68-03d9e792ce56', '2ad07abf-4f32-4506-9f9e-d20757cbad23', '7575ad6a-8646-426c-9ec6-6bc401b90df3'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:26 devstack sudo[84466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:22:26 devstack sudo[84466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:26 devstack sudo[84466]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.592s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:22:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Deleted volume successfully.
Feb 28 01:22:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-19e98c95-69d7-455f-865f-f6bbf215ed76 tempest-VolumeQuotasAdminTestJSON-840287640 None] Lock "cinder-ea98a29a-86c8-49e6-a2cf-5ff767505d31-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:22:36 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:UPDATE=10,cinder:SELECT=10,cinder:DELETE=1,cinder:INSERT=1 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:22:40 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=5,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:22:42 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:22:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Flow 'volume_create_manager' (e0b81242-cfae-4c8a-a517-b65979c8b5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49421a7-428e-4fb4-9a33-4b513c9c6f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49421a7-428e-4fb4-9a33-4b513c9c6f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1861959219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28caaa0-f8bf-4921-bb92-b731ac9f6837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f13446532c43878e603b859666045f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:43Z,use_quota=True,user_id='cf9d7603376242aeb7641fbee5747963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9aaa670-6602-47f2-a347-15fae5bc94ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9aaa670-6602-47f2-a347-15fae5bc94ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f32a83-4caf-4911-8b20-ca521553cea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f32a83-4caf-4911-8b20-ca521553cea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e28caaa0-f8bf-4921-bb92-b731ac9f6837', 'volume_name': 'volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f85784-7e6a-4d04-bd98-2cbfe9bc918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f85784-7e6a-4d04-bd98-2cbfe9bc918d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7751f0d8-2c90-442e-b070-33dff2cf765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:43 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Volume e28caaa0-f8bf-4921-bb92-b731ac9f6837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837', 'volume_size': 1}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1861959219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28caaa0-f8bf-4921-bb92-b731ac9f6837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f13446532c43878e603b859666045f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:43Z,use_quota=True,user_id='cf9d7603376242aeb7641fbee5747963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Creating volume e28caaa0-f8bf-4921-bb92-b731ac9f6837 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:22:43 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:22:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:43 devstack sudo[84851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 1073741824
Feb 28 01:22:43 devstack sudo[84851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:44 devstack sudo[84851]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 1073741824" returned: 0 in 1.143s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:44 devstack sudo[84880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837
Feb 28 01:22:44 devstack sudo[84880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:45 devstack sudo[84880]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837" returned: 0 in 0.910s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:22:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7751f0d8-2c90-442e-b070-33dff2cf765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7877dec7-eab2-4f69-b762-f60e701a6ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:45 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Volume volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 (e28caaa0-f8bf-4921-bb92-b731ac9f6837): created successfully
Feb 28 01:22:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7877dec7-eab2-4f69-b762-f60e701a6ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Flow 'volume_create_manager' (e0b81242-cfae-4c8a-a517-b65979c8b5ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:45 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-07bef2b6-117f-4ab2-89b4-51dcd267e047 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Created volume successfully.
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Creating offline snapshot 7cdd823c-53f7-4881-a648-bfaf38e09bdb of volume e28caaa0-f8bf-4921-bb92-b731ac9f6837 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0019e073-90c2-4f41-832e-e4709ba4fbac]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Flow 'volume_create_manager' (10f675ee-db20-4b26-9b57-a8470d473061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6d1e5d-9248-41ca-8e6d-42d945820f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6d1e5d-9248-41ca-8e6d-42d945820f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-272201720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe3a620-5185-4c6a-a0af-03e45d00243c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c49d6926ac1435694a03a4d96b50d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:47Z,use_quota=True,user_id='3f0ff637f1e44469b4f68e296c7a9fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf0f755-320b-40ef-bee8-fbc8d8ab18e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf0f755-320b-40ef-bee8-fbc8d8ab18e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:46 devstack sudo[84890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837
Feb 28 01:22:46 devstack sudo[84890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2a32f5-cb58-4fce-b25e-8fa167e62581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2a32f5-cb58-4fce-b25e-8fa167e62581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe3a620-5185-4c6a-a0af-03e45d00243c', 'volume_name': 'volume-ebe3a620-5185-4c6a-a0af-03e45d00243c', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae5ed73-2909-4659-b8f3-789afcce1ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae5ed73-2909-4659-b8f3-789afcce1ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09368554-50ae-49d6-94da-2aa6263c3e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:46 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Volume ebe3a620-5185-4c6a-a0af-03e45d00243c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe3a620-5185-4c6a-a0af-03e45d00243c', 'volume_size': 1}
Feb 28 01:22:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:47 devstack sudo[84890]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837" returned: 0 in 1.083s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:47 devstack sudo[84896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb 1G
Feb 28 01:22:47 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:48 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb 1G" returned: 0 in 0.784s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:48 devstack sudo[84902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb
Feb 28 01:22:48 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:49 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb" returned: 0 in 0.619s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:49 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb is being set with open permissions: ugo+rw
Feb 28 01:22:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:49 devstack sudo[84907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb
Feb 28 01:22:49 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:49 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb" returned: 0 in 0.515s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:49 devstack sudo[84916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.info
Feb 28 01:22:49 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:50 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.info" returned: 0 in 0.958s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:50 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.info is being set with open permissions: ugo+rw
Feb 28 01:22:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:50 devstack sudo[84939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.info
Feb 28 01:22:50 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:51 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.info" returned: 0 in 0.727s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.955s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.660s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-272201720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe3a620-5185-4c6a-a0af-03e45d00243c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c49d6926ac1435694a03a4d96b50d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:47Z,use_quota=True,user_id='3f0ff637f1e44469b4f68e296c7a9fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Creating volume ebe3a620-5185-4c6a-a0af-03e45d00243c {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:22:51 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:22:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:51 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-9e5be375-bdea-4fc5-985c-837273e175f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Create snapshot completed successfully
Feb 28 01:22:51 devstack sudo[84942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c 1073741824
Feb 28 01:22:51 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Acquiring lock "cinder-7cdd823c-53f7-4881-a648-bfaf38e09bdb-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:22:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "cinder-7cdd823c-53f7-4881-a648-bfaf38e09bdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:22:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Acquiring lock "cinder-quobyte-e28caaa0-f8bf-4921-bb92-b731ac9f6837" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:22:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "cinder-quobyte-e28caaa0-f8bf-4921-bb92-b731ac9f6837" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:22:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Acquiring lock "cinder-quobyte-7cdd823c-53f7-4881-a648-bfaf38e09bdb" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:22:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "cinder-quobyte-7cdd823c-53f7-4881-a648-bfaf38e09bdb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:22:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Deleting offline snapshot 7cdd823c-53f7-4881-a648-bfaf38e09bdb of volume e28caaa0-f8bf-4921-bb92-b731ac9f6837 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:22:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] snapshot_file for this snap is: volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:22:53 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b55acbb-3696-4a6f-8e84-509fdd3b8d90]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:22:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:53 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c 1073741824" returned: 0 in 1.578s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:53 devstack sudo[84950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c
Feb 28 01:22:53 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:53 devstack sudo[84949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb
Feb 28 01:22:53 devstack sudo[84949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:54 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c" returned: 0 in 0.987s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] <== create_volume: return (2640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.645s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09368554-50ae-49d6-94da-2aa6263c3e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe3a620-5185-4c6a-a0af-03e45d00243c', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:54 devstack sudo[84977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:22:54 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecc2599-9759-4319-860d-3c77021fb3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:54 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Volume volume-ebe3a620-5185-4c6a-a0af-03e45d00243c (ebe3a620-5185-4c6a-a0af-03e45d00243c): created successfully
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecc2599-9759-4319-860d-3c77021fb3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Flow 'volume_create_manager' (10f675ee-db20-4b26-9b57-a8470d473061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:54 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-91aae51e-b674-4800-bd3f-2115610b6a63 tempest-ServerRescueNegativeTestJSON-1442494246 None] Created volume successfully.
Feb 28 01:22:54 devstack sudo[84949]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb" returned: 0 in 1.566s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6308a9fe-ec7f-430e-845e-48b7a68cdc04]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:22:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:54 devstack sudo[84986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837
Feb 28 01:22:54 devstack sudo[84986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:55 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 1.170s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:55 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:22:55 devstack sudo[84986]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837" returned: 0 in 1.043s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:55 devstack sudo[84994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb
Feb 28 01:22:55 devstack sudo[84994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:56 devstack sudo[84994]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb" returned: 0 in 1.073s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:56 devstack sudo[85035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb
Feb 28 01:22:56 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Flow 'volume_create_manager' (ff393b03-5cfe-4bc1-84c9-137d7f88fca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f27589-e715-4519-9760-acee08f04ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f27589-e715-4519-9760-acee08f04ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1331506049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5358624e-3b55-4654-b23d-b7e36a3ba4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6da0a4e2238479f9e2b0f364f5e50bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:57Z,use_quota=True,user_id='c494911eb0e94435b6c87fe5e4cbc009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98e7409-a845-4649-a605-6d87edd47ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98e7409-a845-4649-a605-6d87edd47ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8947ba0e-fd04-4381-8e38-0259cf5da50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8947ba0e-fd04-4381-8e38-0259cf5da50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5358624e-3b55-4654-b23d-b7e36a3ba4aa', 'volume_name': 'volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a45989-a82f-4e09-a0e7-775e943a6295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a45989-a82f-4e09-a0e7-775e943a6295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476b22b9-cdbf-4aae-ae73-21da4cc38dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:57 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Volume 5358624e-3b55-4654-b23d-b7e36a3ba4aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa', 'volume_size': 1}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1331506049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5358624e-3b55-4654-b23d-b7e36a3ba4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6da0a4e2238479f9e2b0f364f5e50bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:22:57Z,use_quota=True,user_id='c494911eb0e94435b6c87fe5e4cbc009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Creating volume 5358624e-3b55-4654-b23d-b7e36a3ba4aa {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:22:57 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:57 devstack sudo[85038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa 1073741824
Feb 28 01:22:57 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:57 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837.7cdd823c-53f7-4881-a648-bfaf38e09bdb" returned: 0 in 0.755s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "cinder-quobyte-7cdd823c-53f7-4881-a648-bfaf38e09bdb" released by "_delete_snapshot" :: held 4.744s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "cinder-quobyte-e28caaa0-f8bf-4921-bb92-b731ac9f6837" released by "delete_snapshot" :: held 4.764s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:22:57 devstack cinder-volume[82470]: WARNING cinder.quota [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Created reservations ['ee12b461-521c-4317-9c6a-19edbd754004', '6413ae48-8e6e-4b7c-8f4f-7b17c70d0c30', 'ebffccc6-b59d-4300-8900-a6aaa3147d91', '1ffbcf6b-6210-42b4-8ee8-4f251632f07b'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:22:57 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Delete snapshot completed successfully.
Feb 28 01:22:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b373814a-0fbd-4af4-92e8-d2c195043fd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "cinder-7cdd823c-53f7-4881-a648-bfaf38e09bdb-delete_snapshot" released by "delete_snapshot" :: held 4.918s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:22:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Acquiring lock "cinder-e28caaa0-f8bf-4921-bb92-b731ac9f6837-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:22:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "cinder-e28caaa0-f8bf-4921-bb92-b731ac9f6837-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:22:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Acquiring lock "cinder-quobyte-e28caaa0-f8bf-4921-bb92-b731ac9f6837" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:22:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "cinder-quobyte-e28caaa0-f8bf-4921-bb92-b731ac9f6837" acquired by "delete_volume" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:22:58 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[832f1561-7f19-4fc9-b15f-dab40a238514]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:22:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:58 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa 1073741824" returned: 0 in 1.256s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:58 devstack sudo[85051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837
Feb 28 01:22:58 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:58 devstack sudo[85074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa
Feb 28 01:22:58 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:59 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837" returned: 0 in 0.854s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:22:59 devstack sudo[85084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837
Feb 28 01:22:59 devstack sudo[85084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:22:59 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root
Feb 28 01:22:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa" returned: 0 in 0.882s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:22:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:22:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:22:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476b22b9-cdbf-4aae-ae73-21da4cc38dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde19807-a66e-4e1a-a32f-55d7bb59210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:22:59 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Volume volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa (5358624e-3b55-4654-b23d-b7e36a3ba4aa): created successfully
Feb 28 01:22:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde19807-a66e-4e1a-a32f-55d7bb59210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:22:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Flow 'volume_create_manager' (ff393b03-5cfe-4bc1-84c9-137d7f88fca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:22:59 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7398f425-8e53-4baf-bd94-623dbadace57 tempest-ServersNegativeTestJSON-1470068492 None] Created volume successfully.
Feb 28 01:23:00 devstack sudo[85084]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e28caaa0-f8bf-4921-bb92-b731ac9f6837" returned: 0 in 0.493s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:00 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "cinder-quobyte-e28caaa0-f8bf-4921-bb92-b731ac9f6837" released by "delete_volume" :: held 1.443s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:00 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Created reservations ['4024cb15-8a6d-4f5c-be71-d0465e0416c9', 'b6e610a1-ae0f-4ae2-a43c-8553ed47501f', '99770a31-05c4-419a-b97c-404e77d985dc', '2d96cce8-3f6a-4733-b40d-37ce0e831c2e'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:00 devstack sudo[85093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:00 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:01 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.927s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:01 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:01 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Deleted volume successfully.
Feb 28 01:23:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-775d5106-970f-4d02-90aa-48f7f3bfcf7f tempest-VolumeSnapshotQuotasNegativeTestJSON-86081657 None] Lock "cinder-e28caaa0-f8bf-4921-bb92-b731ac9f6837-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Flow 'volume_create_manager' (714980d6-1366-4bda-b2a9-a25648cf5880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec75d4e-f74e-4b71-84e9-003d0d34cf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec75d4e-f74e-4b71-84e9-003d0d34cf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1745404992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1383d8d4-c14b-4f65-b526-2d625e9ca446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6da0a4e2238479f9e2b0f364f5e50bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:03Z,use_quota=True,user_id='c494911eb0e94435b6c87fe5e4cbc009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c17ed0-0beb-45d3-8f11-eadebb7e6455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c17ed0-0beb-45d3-8f11-eadebb7e6455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4518005d-0aef-47b6-bf39-41a605f974a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4518005d-0aef-47b6-bf39-41a605f974a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1383d8d4-c14b-4f65-b526-2d625e9ca446', 'volume_name': 'volume-1383d8d4-c14b-4f65-b526-2d625e9ca446', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43d2a8e-9bbe-4bdf-82f2-3cafc6d0da1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43d2a8e-9bbe-4bdf-82f2-3cafc6d0da1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6450fc41-f5cd-44f7-a2d3-1cd33b24ccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:02 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Volume 1383d8d4-c14b-4f65-b526-2d625e9ca446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1383d8d4-c14b-4f65-b526-2d625e9ca446', 'volume_size': 1}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1745404992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1383d8d4-c14b-4f65-b526-2d625e9ca446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6da0a4e2238479f9e2b0f364f5e50bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:03Z,use_quota=True,user_id='c494911eb0e94435b6c87fe5e4cbc009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Creating volume 1383d8d4-c14b-4f65-b526-2d625e9ca446 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:02 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:02 devstack sudo[85132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446 1073741824
Feb 28 01:23:02 devstack sudo[85132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:04 devstack sudo[85132]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446 1073741824" returned: 0 in 1.705s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:04 devstack sudo[85162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446
Feb 28 01:23:04 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:05 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446" returned: 0 in 0.738s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] <== create_volume: return (2495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.497s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6450fc41-f5cd-44f7-a2d3-1cd33b24ccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1383d8d4-c14b-4f65-b526-2d625e9ca446', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c617a72e-b5b5-44bb-9808-a0bf2f553d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:05 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Volume volume-1383d8d4-c14b-4f65-b526-2d625e9ca446 (1383d8d4-c14b-4f65-b526-2d625e9ca446): created successfully
Feb 28 01:23:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c617a72e-b5b5-44bb-9808-a0bf2f553d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Flow 'volume_create_manager' (714980d6-1366-4bda-b2a9-a25648cf5880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:05 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-afad4552-95e6-4a7c-bd06-7d8bd2aa48c5 tempest-ServersNegativeTestJSON-1470068492 None] Created volume successfully.
Feb 28 01:23:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Acquiring lock "cinder-1383d8d4-c14b-4f65-b526-2d625e9ca446-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Lock "cinder-1383d8d4-c14b-4f65-b526-2d625e9ca446-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Acquiring lock "cinder-quobyte-1383d8d4-c14b-4f65-b526-2d625e9ca446" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Lock "cinder-quobyte-1383d8d4-c14b-4f65-b526-2d625e9ca446" acquired by "delete_volume" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f081093-2bc3-4f7a-996d-6b1156e320c7]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:06 devstack sudo[85167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446
Feb 28 01:23:06 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:07 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446" returned: 0 in 1.033s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:07 devstack sudo[85173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446
Feb 28 01:23:07 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:08 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1383d8d4-c14b-4f65-b526-2d625e9ca446" returned: 0 in 0.810s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Lock "cinder-quobyte-1383d8d4-c14b-4f65-b526-2d625e9ca446" released by "delete_volume" :: held 1.934s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:08 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Created reservations ['9705676a-b718-4ac0-9229-41ed2dd21b14', '23620063-0c1d-486c-b458-316c7ddb0d25', 'b6590aa0-c0f8-4ff6-8519-675597364f42', 'be5453f2-65e0-4710-9ec7-f820b51c6230'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:08 devstack sudo[85196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:08 devstack sudo[85196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Acquiring lock "cinder-5358624e-3b55-4654-b23d-b7e36a3ba4aa-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Lock "cinder-5358624e-3b55-4654-b23d-b7e36a3ba4aa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Acquiring lock "cinder-quobyte-5358624e-3b55-4654-b23d-b7e36a3ba4aa" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Lock "cinder-quobyte-5358624e-3b55-4654-b23d-b7e36a3ba4aa" acquired by "delete_volume" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:09 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[17717a47-fdbc-499b-b6cb-f1f7b217f012]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:09 devstack sudo[85204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa
Feb 28 01:23:09 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:09 devstack sudo[85196]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 1.133s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:09 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:09 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Deleted volume successfully.
Feb 28 01:23:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3eac3acd-0d0b-45ca-9302-985f17c1f6c9 tempest-ServersNegativeTestJSON-1470068492 None] Lock "cinder-1383d8d4-c14b-4f65-b526-2d625e9ca446-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:11 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa" returned: 0 in 1.795s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:11 devstack sudo[85255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa
Feb 28 01:23:11 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:12 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5358624e-3b55-4654-b23d-b7e36a3ba4aa" returned: 0 in 0.900s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Lock "cinder-quobyte-5358624e-3b55-4654-b23d-b7e36a3ba4aa" released by "delete_volume" :: held 2.810s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Created reservations ['2abc0205-de16-4088-bc4e-5b91dc5b1362', '195709d8-1122-4428-ba5a-1594ddedc688', '287fb53f-9a45-4577-9589-d2167c51a33e', '432cd401-4c41-4d7f-a620-fa9239913983'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:12 devstack sudo[85261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:12 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Acquiring lock "cinder-ebe3a620-5185-4c6a-a0af-03e45d00243c-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Lock "cinder-ebe3a620-5185-4c6a-a0af-03e45d00243c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Acquiring lock "cinder-quobyte-ebe3a620-5185-4c6a-a0af-03e45d00243c" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Lock "cinder-quobyte-ebe3a620-5185-4c6a-a0af-03e45d00243c" acquired by "delete_volume" :: waited 0.016s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb2c632-7c1f-4981-b7ec-ae4599e32b3f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:12 devstack sudo[85263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c
Feb 28 01:23:12 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:13 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Flow 'volume_create_manager' (af720878-f35d-480f-9abe-90fbbfe02627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9386627e-a1a0-497b-8d61-aff48afe5e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 1.067s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9386627e-a1a0-497b-8d61-aff48afe5e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-856461669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d21cf8d-14b7-435c-8842-73fe6895a94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a6a530659744478310a170ebc91dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:13Z,use_quota=True,user_id='a73b7834287a4efbae77e3766b9d4c08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd89355c-5bf6-4610-b0be-43d463b3c0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd89355c-5bf6-4610-b0be-43d463b3c0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326378d6-5f66-49dd-87a0-7c510ee235a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326378d6-5f66-49dd-87a0-7c510ee235a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d21cf8d-14b7-435c-8842-73fe6895a94b', 'volume_name': 'volume-9d21cf8d-14b7-435c-8842-73fe6895a94b', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701e431b-7475-479c-8596-53c6ca2a079c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701e431b-7475-479c-8596-53c6ca2a079c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fe7e82-2a8a-4c3d-a149-cce4c548c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:13 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Volume 9d21cf8d-14b7-435c-8842-73fe6895a94b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d21cf8d-14b7-435c-8842-73fe6895a94b', 'volume_size': 1}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-856461669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d21cf8d-14b7-435c-8842-73fe6895a94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a6a530659744478310a170ebc91dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:13Z,use_quota=True,user_id='a73b7834287a4efbae77e3766b9d4c08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Creating volume 9d21cf8d-14b7-435c-8842-73fe6895a94b {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:13 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:13 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Deleted volume successfully.
Feb 28 01:23:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b498a5e8-7706-4a22-aad6-5bbb669c0aa8 tempest-ServersNegativeTestJSON-1470068492 None] Lock "cinder-5358624e-3b55-4654-b23d-b7e36a3ba4aa-delete_volume" released by "delete_volume" :: held 4.345s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:13 devstack sudo[85266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b 1073741824
Feb 28 01:23:13 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:14 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c" returned: 0 in 1.465s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:14 devstack sudo[85271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c
Feb 28 01:23:14 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:15 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b 1073741824" returned: 0 in 1.748s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:15 devstack sudo[85301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b
Feb 28 01:23:15 devstack sudo[85301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:15 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ebe3a620-5185-4c6a-a0af-03e45d00243c" returned: 0 in 1.318s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Lock "cinder-quobyte-ebe3a620-5185-4c6a-a0af-03e45d00243c" released by "delete_volume" :: held 2.890s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Created reservations ['03fb0df3-d85d-4185-b618-4aaadc38a67a', '54c209fe-f9a1-410f-b42c-206ac8acf862', '40815939-ba3b-472c-8227-456510d6a12a', 'ebf1dd93-5ef7-4e06-82ef-d79bcae41516'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:15 devstack sudo[85306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:15 devstack sudo[85306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:16 devstack sudo[85301]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b" returned: 0 in 1.115s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] <== create_volume: return (2920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.927s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fe7e82-2a8a-4c3d-a149-cce4c548c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d21cf8d-14b7-435c-8842-73fe6895a94b', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68003a72-58eb-4682-b6ba-897c25608ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:16 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Volume volume-9d21cf8d-14b7-435c-8842-73fe6895a94b (9d21cf8d-14b7-435c-8842-73fe6895a94b): created successfully
Feb 28 01:23:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68003a72-58eb-4682-b6ba-897c25608ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Flow 'volume_create_manager' (af720878-f35d-480f-9abe-90fbbfe02627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:16 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1c368045-ea2e-4add-b493-ac58f1ce7ce1 tempest-AbsoluteLimitsTests-1564659608 None] Created volume successfully.
Feb 28 01:23:16 devstack sudo[85306]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 1.003s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:16 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:16 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Deleted volume successfully.
Feb 28 01:23:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a1851230-64b5-455c-8cfc-e295d2c5d8f4 tempest-ServerRescueNegativeTestJSON-1442494246 None] Lock "cinder-ebe3a620-5185-4c6a-a0af-03e45d00243c-delete_volume" released by "delete_volume" :: held 4.239s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Acquiring lock "cinder-9d21cf8d-14b7-435c-8842-73fe6895a94b-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Lock "cinder-9d21cf8d-14b7-435c-8842-73fe6895a94b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Acquiring lock "cinder-quobyte-9d21cf8d-14b7-435c-8842-73fe6895a94b" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Lock "cinder-quobyte-9d21cf8d-14b7-435c-8842-73fe6895a94b" acquired by "delete_volume" :: waited 0.022s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:17 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfe8005-c656-44bd-a292-a7f66c096d4b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:17 devstack sudo[85329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b
Feb 28 01:23:17 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:18 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b" returned: 0 in 0.991s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:18 devstack sudo[85355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b
Feb 28 01:23:18 devstack sudo[85355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:18 devstack sudo[85355]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d21cf8d-14b7-435c-8842-73fe6895a94b" returned: 0 in 0.434s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Lock "cinder-quobyte-9d21cf8d-14b7-435c-8842-73fe6895a94b" released by "delete_volume" :: held 1.564s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Created reservations ['8bc69c8b-493f-4f27-ae4e-5609c2bc8750', '3471778f-14e7-42fa-ad2d-2e480655fccc', 'ab5deb0b-dc31-4bdd-901b-ad43b8975e95', '0f9c4211-6eb7-4a72-84b4-56d3b7fe44ba'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:18 devstack sudo[85359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:18 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:19 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.688s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:19 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:19 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Deleted volume successfully.
Feb 28 01:23:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3ede1944-08b8-4958-a637-bfbc837dad1e tempest-AbsoluteLimitsTests-1564659608 None] Lock "cinder-9d21cf8d-14b7-435c-8842-73fe6895a94b-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Flow 'volume_create_manager' (f9ed1e6a-ede7-47b0-b080-fc56974f66c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e721ae30-b552-4f46-a33a-f753893acbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e721ae30-b552-4f46-a33a-f753893acbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:24Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687572f3832e47129c072cb436f8164b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:24Z,use_quota=True,user_id='6914c147ffba4dd49eb62db9b3bf3c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c201c939-345d-4c5c-a366-6c8d6f7e1362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c201c939-345d-4c5c-a366-6c8d6f7e1362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39b3d6c-be34-4c23-adc4-b6b098a1ab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.image.glance [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Creating Keystone auth plugin from conf {{(pid=82470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39b3d6c-be34-4c23-adc4-b6b098a1ab9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea', 'volume_name': 'volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc613f5e0>}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212f961a-7677-4961-9578-cfaa9c450931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212f961a-7677-4961-9578-cfaa9c450931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280f14ed-727c-4f7c-a714-99bf2e0672fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:24 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Volume fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc613f5e0>}
Feb 28 01:23:24 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Trying to clone fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea from image 9351240e-6df5-4131-8ea1-feeaf12d9c21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]). {{(pid=82470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 28 01:23:25 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 28 01:23:25 devstack cinder-volume[82470]: INFO cinder.image.image_utils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Image download 20.69 MB at 20.69 MB/s
Feb 28 01:23:25 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a282b7-f6a0-471b-b9a6-e87d1aa014af]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:25 devstack sudo[85387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD
Feb 28 01:23:25 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:25 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:25 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Temporary image 9351240e-6df5-4131-8ea1-feeaf12d9c21 is fetched for user 6914c147ffba4dd49eb62db9b3bf3c2d. {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 28 01:23:25 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Flow 'volume_create_manager' (dcb8f767-015d-4ce7-be8c-3631b016ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b023ee22-fbc4-449b-b84a-2512a42519cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b023ee22-fbc4-449b-b84a-2512a42519cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-225578839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93dc2400-0112-4fc9-9e8f-05a7170d7ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3468c30f87bb4a4094c917e90aab4bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:26Z,use_quota=True,user_id='2086905474c9418aac8d4693a3a78b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd37008c-c622-4009-bdd7-16b805e5f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd37008c-c622-4009-bdd7-16b805e5f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd094d8a-ef4b-4793-bd8f-105defeeb0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd094d8a-ef4b-4793-bd8f-105defeeb0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93dc2400-0112-4fc9-9e8f-05a7170d7ba0', 'volume_name': 'volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e8c68d-b410-4796-8a4f-736edffdfc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e8c68d-b410-4796-8a4f-736edffdfc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a97330-5a89-432e-ae19-3869105ca893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:26 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Volume 93dc2400-0112-4fc9-9e8f-05a7170d7ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0', 'volume_size': 1}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-225578839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93dc2400-0112-4fc9-9e8f-05a7170d7ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3468c30f87bb4a4094c917e90aab4bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:26Z,use_quota=True,user_id='2086905474c9418aac8d4693a3a78b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Creating volume 93dc2400-0112-4fc9-9e8f-05a7170d7ba0 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:26 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafab32c-127f-45d5-8edf-6df31c1dc684]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:26 devstack sudo[85416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0 1073741824
Feb 28 01:23:26 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:26 devstack sudo[85417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD
Feb 28 01:23:26 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:26 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0 1073741824" returned: 0 in 0.761s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:27 devstack sudo[85429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0
Feb 28 01:23:27 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:27 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD" returned: 0 in 1.003s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:27 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0" returned: 0 in 0.712s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.527s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:24Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687572f3832e47129c072cb436f8164b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:24Z,use_quota=True,user_id='6914c147ffba4dd49eb62db9b3bf3c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Creating volume fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:27 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a97330-5a89-432e-ae19-3869105ca893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:27 devstack sudo[85434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea 1073741824
Feb 28 01:23:27 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0c8a12-11ed-4dd7-89a7-72f155e89f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:27 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Volume volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0 (93dc2400-0112-4fc9-9e8f-05a7170d7ba0): created successfully
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0c8a12-11ed-4dd7-89a7-72f155e89f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Flow 'volume_create_manager' (dcb8f767-015d-4ce7-be8c-3631b016ba40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:27 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8506d839-448e-4539-8a2a-875ae9e0caae tempest-VolumesTransfersV357Test-794258651 None] Created volume successfully.
Feb 28 01:23:28 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea 1073741824" returned: 0 in 0.680s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:28 devstack sudo[85439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea
Feb 28 01:23:28 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:28 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-87ee3a18-d62e-4a5f-af26-be8fbde3a14c tempest-VolumesTransfersV357Test-169328471 None] Transfer volume completed successfully.
Feb 28 01:23:28 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" returned: 0 in 0.496s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:28 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Attempting download of 9351240e-6df5-4131-8ea1-feeaf12d9c21 ((None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}])) to volume fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea. {{(pid=82470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 28 01:23:29 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed147382-6c05-45c1-976b-c9d733659894]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_i85t29ia {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:29 devstack sudo[85442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_i85t29ia
Feb 28 01:23:29 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:29 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_i85t29ia" returned: 0 in 0.712s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_i85t29ia {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:29 devstack sudo[85446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_i85t29ia
Feb 28 01:23:29 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:29 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Acquiring lock "cinder-93dc2400-0112-4fc9-9e8f-05a7170d7ba0-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:29 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Lock "cinder-93dc2400-0112-4fc9-9e8f-05a7170d7ba0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:29 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Acquiring lock "cinder-quobyte-93dc2400-0112-4fc9-9e8f-05a7170d7ba0" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:29 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Lock "cinder-quobyte-93dc2400-0112-4fc9-9e8f-05a7170d7ba0" acquired by "delete_volume" :: waited 0.017s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:29 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4e45b2-161e-454b-bad8-8a28d1612570]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:30 devstack sudo[85448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0
Feb 28 01:23:30 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Flow 'volume_create_manager' (e47f3e6a-72c5-4cca-ad67-c18b6d436277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32356108-9304-4747-a422-4a484cbf9d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32356108-9304-4747-a422-4a484cbf9d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-802711351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21f54e9-c225-4c7a-bbc6-94f443ba2900,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18583a3999e34cb492ced1f41c748297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:30Z,use_quota=True,user_id='b7deaef01cca4611bb7c161dc7bb228f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7251ec37-f7b0-41eb-980c-e2a82c003c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7251ec37-f7b0-41eb-980c-e2a82c003c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe2d704-6024-47fa-83c7-c65c7faafce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe2d704-6024-47fa-83c7-c65c7faafce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21f54e9-c225-4c7a-bbc6-94f443ba2900', 'volume_name': 'volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5233db43-8ae8-4171-b46d-411273ac68f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5233db43-8ae8-4171-b46d-411273ac68f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e89b0f-a535-442d-a433-25c4eb397f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:30 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Volume a21f54e9-c225-4c7a-bbc6-94f443ba2900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900', 'volume_size': 1}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-802711351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21f54e9-c225-4c7a-bbc6-94f443ba2900,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18583a3999e34cb492ced1f41c748297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:30Z,use_quota=True,user_id='b7deaef01cca4611bb7c161dc7bb228f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Creating volume a21f54e9-c225-4c7a-bbc6-94f443ba2900 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:30 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:30 devstack sudo[85455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900 1073741824
Feb 28 01:23:30 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:30 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_i85t29ia" returned: 1 in 0.599s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_i85t29ia' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8996b5-bf16-477a-982d-5a8e4333a012]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:30 devstack sudo[85457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD
Feb 28 01:23:30 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:30 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0" returned: 0 in 0.606s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:30 devstack sudo[85462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0
Feb 28 01:23:30 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:30 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] 9351240e-6df5-4131-8ea1-feeaf12d9c21 was qcow2, converting to raw {{(pid=82470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:30 devstack sudo[85473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea
Feb 28 01:23:30 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:30 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900 1073741824" returned: 0 in 0.704s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:31 devstack sudo[85475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900
Feb 28 01:23:31 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:31 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93dc2400-0112-4fc9-9e8f-05a7170d7ba0" returned: 0 in 0.579s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Lock "cinder-quobyte-93dc2400-0112-4fc9-9e8f-05a7170d7ba0" released by "delete_volume" :: held 1.218s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Created reservations ['f481c0dc-35a2-4092-912d-934bf847623f', '586a9508-6e44-4c30-b9cb-392bdb4e1f89', '7abca7ef-22dd-48a2-a767-df4003027c06', '643831ef-1821-4e57-bf69-3582f093fae6'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:31 devstack sudo[85478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:31 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:31 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900" returned: 0 in 0.521s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e89b0f-a535-442d-a433-25c4eb397f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680fe259-537c-47f5-917d-48d1810c1ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:31 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Volume volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900 (a21f54e9-c225-4c7a-bbc6-94f443ba2900): created successfully
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680fe259-537c-47f5-917d-48d1810c1ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Flow 'volume_create_manager' (e47f3e6a-72c5-4cca-ad67-c18b6d436277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:31 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-24a1c4c3-3112-49c8-8df7-54478529e13f tempest-VolumesTestJSON-1077934086 None] Created volume successfully.
Feb 28 01:23:31 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.549s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:31 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Deleted volume successfully.
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8057862-baf5-4bb0-a766-9aa6b7b0585f tempest-VolumesTransfersV357Test-1477325821 None] Lock "cinder-93dc2400-0112-4fc9-9e8f-05a7170d7ba0-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:31 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" returned: 0 in 0.995s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_3mpr3ykudevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:23:31 devstack cinder-volume[82470]: INFO cinder.image.image_utils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Converted 112.00 MB image at 112.00 MB/s
Feb 28 01:23:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:31 devstack sudo[85491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea 1G
Feb 28 01:23:31 devstack sudo[85491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Flow 'volume_create_manager' (677337e0-4636-44e3-897b-4ef163d5ac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3163264-d4c8-44c5-a913-627bf7a7da51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3163264-d4c8-44c5-a913-627bf7a7da51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1974673810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109e62a4-1a93-4361-8e8b-a1f35f0c27c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3468c30f87bb4a4094c917e90aab4bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:33Z,use_quota=True,user_id='2086905474c9418aac8d4693a3a78b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f4a32f-7ef4-40e5-963a-0b31befdecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f4a32f-7ef4-40e5-963a-0b31befdecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63b68c3-10be-4b5e-bd37-2ccdff132fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63b68c3-10be-4b5e-bd37-2ccdff132fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109e62a4-1a93-4361-8e8b-a1f35f0c27c8', 'volume_name': 'volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88609278-4c31-4047-81b0-706a526776db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:32 devstack sudo[85491]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88609278-4c31-4047-81b0-706a526776db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f742656-296e-4748-8ac2-415e1f313706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:32 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Volume 109e62a4-1a93-4361-8e8b-a1f35f0c27c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8', 'volume_size': 1}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1974673810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109e62a4-1a93-4361-8e8b-a1f35f0c27c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3468c30f87bb4a4094c917e90aab4bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:33Z,use_quota=True,user_id='2086905474c9418aac8d4693a3a78b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Creating volume 109e62a4-1a93-4361-8e8b-a1f35f0c27c8 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:32 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea 1G" returned: 0 in 0.865s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:32 devstack sudo[85496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8 1073741824
Feb 28 01:23:32 devstack sudo[85496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a58ded-5d49-43c4-87d4-5416fc38d6ac]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Flow 'volume_create_manager' (413394b4-95fb-488b-b5d8-773d9a4fe7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb5c518-9a85-42d0-9cbb-ce19408f6835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb5c518-9a85-42d0-9cbb-ce19408f6835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1554227896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596b1712-5a03-4bfa-8912-1a050c2bb28c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18583a3999e34cb492ced1f41c748297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:33Z,use_quota=True,user_id='b7deaef01cca4611bb7c161dc7bb228f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd7803c-9f1c-4799-adc4-27aae8545c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd7803c-9f1c-4799-adc4-27aae8545c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11da6678-bff8-4d5d-9ccf-db28f287b287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11da6678-bff8-4d5d-9ccf-db28f287b287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596b1712-5a03-4bfa-8912-1a050c2bb28c', 'volume_name': 'volume-596b1712-5a03-4bfa-8912-1a050c2bb28c', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f3a2a7-8872-47ec-97ad-e70acb588afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f3a2a7-8872-47ec-97ad-e70acb588afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a3a685-62f9-42b2-9f8d-95365e640e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:32 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Volume 596b1712-5a03-4bfa-8912-1a050c2bb28c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596b1712-5a03-4bfa-8912-1a050c2bb28c', 'volume_size': 1}
Feb 28 01:23:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:32 devstack sudo[85498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea
Feb 28 01:23:32 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:33 devstack sudo[85496]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8 1073741824" returned: 0 in 0.579s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:33 devstack sudo[85505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8
Feb 28 01:23:33 devstack sudo[85505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:33 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" returned: 0 in 0.651s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:33 devstack sudo[85508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea
Feb 28 01:23:33 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:33 devstack sudo[85505]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8" returned: 0 in 0.541s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.995s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1554227896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596b1712-5a03-4bfa-8912-1a050c2bb28c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18583a3999e34cb492ced1f41c748297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:33Z,use_quota=True,user_id='b7deaef01cca4611bb7c161dc7bb228f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Creating volume 596b1712-5a03-4bfa-8912-1a050c2bb28c {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:33 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f742656-296e-4748-8ac2-415e1f313706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afb758d-df23-47c0-bc5d-e3609ef310a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:33 devstack sudo[85511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c 1073741824
Feb 28 01:23:33 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:33 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Volume volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8 (109e62a4-1a93-4361-8e8b-a1f35f0c27c8): created successfully
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afb758d-df23-47c0-bc5d-e3609ef310a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Flow 'volume_create_manager' (677337e0-4636-44e3-897b-4ef163d5ac5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:33 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-36d432e4-b9db-46d6-b1bb-bb522ace498b tempest-VolumesTransfersV357Test-794258651 None] Created volume successfully.
Feb 28 01:23:34 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" returned: 1 in 0.730s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Downloaded image 9351240e-6df5-4131-8ea1-feeaf12d9c21 ((None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}])) to volume fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea successfully. {{(pid=82470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Temporary image 9351240e-6df5-4131-8ea1-feeaf12d9c21 for user 6914c147ffba4dd49eb62db9b3bf3c2d is deleted. {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Marking volume fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea as bootable. {{(pid=82470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Copying metadata from image 9351240e-6df5-4131-8ea1-feeaf12d9c21 to fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea. {{(pid=82470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Creating volume glance metadata for volume fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea backed by image 9351240e-6df5-4131-8ea1-feeaf12d9c21 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280f14ed-727c-4f7c-a714-99bf2e0672fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc613f5e0>}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb479f67-c219-4507-adeb-7275c2ffd7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:34 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Volume volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea (fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea): created successfully
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb479f67-c219-4507-adeb-7275c2ffd7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Flow 'volume_create_manager' (f9ed1e6a-ede7-47b0-b080-fc56974f66c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:34 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-6d2a59a7-2383-49f4-8f98-535cca2a32b4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Created volume successfully.
Feb 28 01:23:34 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c 1073741824" returned: 0 in 0.580s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:34 devstack sudo[85520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c
Feb 28 01:23:34 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Acquiring lock "cinder-109e62a4-1a93-4361-8e8b-a1f35f0c27c8-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Lock "cinder-109e62a4-1a93-4361-8e8b-a1f35f0c27c8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Acquiring lock "cinder-quobyte-109e62a4-1a93-4361-8e8b-a1f35f0c27c8" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:35 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Lock "cinder-quobyte-109e62a4-1a93-4361-8e8b-a1f35f0c27c8" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c" returned: 0 in 0.596s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5432d0-6472-45fc-98f5-b6a63813c241]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a3a685-62f9-42b2-9f8d-95365e640e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596b1712-5a03-4bfa-8912-1a050c2bb28c', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee6d8ae-90ed-4233-873f-e6dd69ab63a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:35 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Volume volume-596b1712-5a03-4bfa-8912-1a050c2bb28c (596b1712-5a03-4bfa-8912-1a050c2bb28c): created successfully
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee6d8ae-90ed-4233-873f-e6dd69ab63a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Flow 'volume_create_manager' (413394b4-95fb-488b-b5d8-773d9a4fe7f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:35 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-afdbc393-4fce-4542-a430-1c544893f05b tempest-VolumesTestJSON-1077934086 None] Created volume successfully.
Feb 28 01:23:35 devstack sudo[85523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8
Feb 28 01:23:35 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:35 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8" returned: 0 in 0.523s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:35 devstack sudo[85528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8
Feb 28 01:23:35 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:36 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-109e62a4-1a93-4361-8e8b-a1f35f0c27c8" returned: 0 in 0.498s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Lock "cinder-quobyte-109e62a4-1a93-4361-8e8b-a1f35f0c27c8" released by "delete_volume" :: held 1.060s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Created reservations ['36336298-b022-4829-aeb5-4ba1cb1b4565', 'ee0f7182-f402-4e91-8760-41959d221028', '6f206819-fc4c-4910-913d-7a7b63033634', 'dd3ecb8d-8a57-447d-90ee-9bceba2ad995'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=60,cinder:UPDATE=95,cinder:DELETE=9,cinder:INSERT=20 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:36 devstack sudo[85531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:36 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Flow 'volume_create_manager' (79120f98-749d-42bd-ab64-90d1baa74c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e0ecfb-24ae-40d1-87a0-9aa3e61283ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e0ecfb-24ae-40d1-87a0-9aa3e61283ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-12397977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7593082-983c-45c1-8c3e-ce889004f884,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18583a3999e34cb492ced1f41c748297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:36Z,use_quota=True,user_id='b7deaef01cca4611bb7c161dc7bb228f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6440ab5-ba93-41a8-802f-4e1f14d54d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6440ab5-ba93-41a8-802f-4e1f14d54d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16a2f8e-4252-4ed5-94a3-cab9bd3211b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16a2f8e-4252-4ed5-94a3-cab9bd3211b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7593082-983c-45c1-8c3e-ce889004f884', 'volume_name': 'volume-f7593082-983c-45c1-8c3e-ce889004f884', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39670c1f-9778-44aa-8b88-65c24d075e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39670c1f-9778-44aa-8b88-65c24d075e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0cd93f-6ab8-454c-8b5a-d4bf684ab129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:36 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Volume f7593082-983c-45c1-8c3e-ce889004f884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7593082-983c-45c1-8c3e-ce889004f884', 'volume_size': 1}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-12397977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7593082-983c-45c1-8c3e-ce889004f884,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18583a3999e34cb492ced1f41c748297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:36Z,use_quota=True,user_id='b7deaef01cca4611bb7c161dc7bb228f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Creating volume f7593082-983c-45c1-8c3e-ce889004f884 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:36 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:36 devstack sudo[85541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884 1073741824
Feb 28 01:23:36 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-3a65985f-3088-4b29-b89d-42467813aa7e tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:36 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.629s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:36 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Deleted volume successfully.
Feb 28 01:23:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d42c41a9-0d89-467e-bd9a-c771c4f7f12b tempest-VolumesTransfersV357Test-1477325821 None] Lock "cinder-109e62a4-1a93-4361-8e8b-a1f35f0c27c8-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Flow 'volume_create_manager' (ef0998b0-fd00-4835-ada8-5642e2e318b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2de0e01-9650-45fc-a769-272f80443050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2de0e01-9650-45fc-a769-272f80443050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1487898604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265a2372-59fd-47e2-bc4b-de8d7122cc0a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b00605156841414ba4e2f10ebbd9b73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:37Z,use_quota=True,user_id='7f82acbee1df4e3db97434ecadfc0583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4b2116-dd8e-4192-a7f3-822d1f11715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4b2116-dd8e-4192-a7f3-822d1f11715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72efc521-8e13-4330-b8f7-48c90e2851ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72efc521-8e13-4330-b8f7-48c90e2851ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265a2372-59fd-47e2-bc4b-de8d7122cc0a', 'volume_name': 'volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14f75d0-ec20-41f1-81ef-aee81d319cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14f75d0-ec20-41f1-81ef-aee81d319cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84ec99d-ddce-431a-9b6a-6f1ab9a769a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:37 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Volume 265a2372-59fd-47e2-bc4b-de8d7122cc0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a', 'volume_size': 1}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:37 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884 1073741824" returned: 0 in 0.779s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:37 devstack sudo[85551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884
Feb 28 01:23:37 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:38 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884" returned: 0 in 0.587s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-3a65985f-3088-4b29-b89d-42467813aa7e tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.323s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0cd93f-6ab8-454c-8b5a-d4bf684ab129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7593082-983c-45c1-8c3e-ce889004f884', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f08e15-5e53-4833-b95b-9ca6da6ad9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:38 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Volume volume-f7593082-983c-45c1-8c3e-ce889004f884 (f7593082-983c-45c1-8c3e-ce889004f884): created successfully
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f08e15-5e53-4833-b95b-9ca6da6ad9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Flow 'volume_create_manager' (79120f98-749d-42bd-ab64-90d1baa74c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[527585b8-c195-4207-9e31-56a19eac9f4f]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-3a65985f-3088-4b29-b89d-42467813aa7e tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:38 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-984e3140-e918-473c-911a-48fa58ad5c47 tempest-VolumesTestJSON-1077934086 None] Created volume successfully.
Feb 28 01:23:38 devstack sudo[85595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea
Feb 28 01:23:38 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:38 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-3a65985f-3088-4b29-b89d-42467813aa7e tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" returned: 0 in 0.749s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-3a65985f-3088-4b29-b89d-42467813aa7e tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:39 devstack sudo[85602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea
Feb 28 01:23:39 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Acquiring lock "cinder-f7593082-983c-45c1-8c3e-ce889004f884-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Lock "cinder-f7593082-983c-45c1-8c3e-ce889004f884-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:39 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-3a65985f-3088-4b29-b89d-42467813aa7e tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" returned: 1 in 0.758s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-3a65985f-3088-4b29-b89d-42467813aa7e tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-3a65985f-3088-4b29-b89d-42467813aa7e tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.611s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.576s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1487898604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265a2372-59fd-47e2-bc4b-de8d7122cc0a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b00605156841414ba4e2f10ebbd9b73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:37Z,use_quota=True,user_id='7f82acbee1df4e3db97434ecadfc0583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Creating volume 265a2372-59fd-47e2-bc4b-de8d7122cc0a {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:39 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:39 devstack sudo[85607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a 1073741824
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Acquiring lock "cinder-quobyte-f7593082-983c-45c1-8c3e-ce889004f884" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:39 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-3a65985f-3088-4b29-b89d-42467813aa7e tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc', 'name': 'volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01474289-d032-4449-aa12-5df832bcdf7d', 'enforce_multipath': True} {{(pid=82470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Lock "cinder-quobyte-f7593082-983c-45c1-8c3e-ce889004f884" acquired by "delete_volume" :: waited 0.027s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ee2390-6fcd-4258-aa4f-947aa7297a55]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:39 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-c7cda0ad-e2ed-495c-97c9-56fb0df75da8 req-3a65985f-3088-4b29-b89d-42467813aa7e tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] attachment_update completed successfully.
Feb 28 01:23:39 devstack sudo[85609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884
Feb 28 01:23:39 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:40 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a 1073741824" returned: 0 in 0.767s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:UPDATE=102,cinder:SELECT=94,cinder:INSERT=37,cinder:DELETE=9 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:40 devstack sudo[85623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a
Feb 28 01:23:40 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:40 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884" returned: 0 in 0.793s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:40 devstack sudo[85625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884
Feb 28 01:23:40 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:40 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a" returned: 0 in 0.468s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84ec99d-ddce-431a-9b6a-6f1ab9a769a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63f1dbf-bba7-4da1-a4d4-f014fff6302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:40 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Volume volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a (265a2372-59fd-47e2-bc4b-de8d7122cc0a): created successfully
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63f1dbf-bba7-4da1-a4d4-f014fff6302d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Flow 'volume_create_manager' (ef0998b0-fd00-4835-ada8-5642e2e318b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:40 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-2efa795e-1252-4b62-b896-aef07e3b36a9 req-1fedf095-a15d-4b03-a7dd-9422c0cc2bae tempest-VolumesGetTestJSON-2145404780 None] Created volume successfully.
Feb 28 01:23:41 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7593082-983c-45c1-8c3e-ce889004f884" returned: 0 in 0.456s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Lock "cinder-quobyte-f7593082-983c-45c1-8c3e-ce889004f884" released by "delete_volume" :: held 1.291s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Created reservations ['ece753b9-b653-4c42-9700-1ebff87713be', '3b1f33fb-0266-4c17-b6e5-c850fe0b90e4', 'bb043cc6-87a7-4384-94b0-12341cf6aa8d', 'b1f920ce-b685-43a7-8bbd-7d29f598b21b'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:41 devstack sudo[85629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:41 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Flow 'volume_create_manager' (4e813bc8-ab3a-4ce0-a2eb-961942a5a306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c937ae-b277-4c9d-9cff-34d18362b934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c937ae-b277-4c9d-9cff-34d18362b934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-917903996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b31be15e9b241f9ae6d66436c181eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:41Z,use_quota=True,user_id='ada8043052ce42b3ac8b0375d5b7e774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cc0a81-3579-4afc-82fb-9a591450601a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cc0a81-3579-4afc-82fb-9a591450601a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afcbd4b-997c-4348-917a-266a51743134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afcbd4b-997c-4348-917a-266a51743134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4', 'volume_name': 'volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc8a248-59e8-424a-b6c6-010c3437d680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc8a248-59e8-424a-b6c6-010c3437d680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7301de-232c-4a56-af05-620787529df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:41 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Volume 0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4', 'volume_size': 1}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-917903996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b31be15e9b241f9ae6d66436c181eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:41Z,use_quota=True,user_id='ada8043052ce42b3ac8b0375d5b7e774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Creating volume 0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:41 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:41 devstack sudo[85632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 1073741824
Feb 28 01:23:41 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:41 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.465s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:41 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Deleted volume successfully.
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-717e8bd5-7ace-4177-830a-3324bf8a11cd tempest-VolumesTestJSON-1077934086 None] Lock "cinder-f7593082-983c-45c1-8c3e-ce889004f884-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Acquiring lock "cinder-265a2372-59fd-47e2-bc4b-de8d7122cc0a-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Lock "cinder-265a2372-59fd-47e2-bc4b-de8d7122cc0a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Acquiring lock "cinder-quobyte-265a2372-59fd-47e2-bc4b-de8d7122cc0a" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Lock "cinder-quobyte-265a2372-59fd-47e2-bc4b-de8d7122cc0a" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[602e839b-35ec-4da2-8b39-00f98474ee20]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Acquiring lock "cinder-596b1712-5a03-4bfa-8912-1a050c2bb28c-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Lock "cinder-596b1712-5a03-4bfa-8912-1a050c2bb28c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:41 devstack sudo[85635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a
Feb 28 01:23:41 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Acquiring lock "cinder-quobyte-596b1712-5a03-4bfa-8912-1a050c2bb28c" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Lock "cinder-quobyte-596b1712-5a03-4bfa-8912-1a050c2bb28c" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7435965-6d84-4091-b57b-4cc816c7326b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:42 devstack sudo[85640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c
Feb 28 01:23:42 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:42 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 1073741824" returned: 0 in 0.523s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:42 devstack sudo[85642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4
Feb 28 01:23:42 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:42 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a" returned: 0 in 0.541s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:42 devstack sudo[85647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a
Feb 28 01:23:42 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:42 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c" returned: 0 in 0.531s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:42 devstack sudo[85653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c
Feb 28 01:23:42 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:42 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4" returned: 0 in 0.445s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7301de-232c-4a56-af05-620787529df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a885fcea-038e-43c2-96f8-25ae8bf7193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Volume volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 (0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4): created successfully
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a885fcea-038e-43c2-96f8-25ae8bf7193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Flow 'volume_create_manager' (4e813bc8-ab3a-4ce0-a2eb-961942a5a306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:42 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d59d3eaa-f293-4559-9be8-d5669bfd6ece tempest-VolumesCloneTest-1566530466 None] Created volume successfully.
Feb 28 01:23:42 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-265a2372-59fd-47e2-bc4b-de8d7122cc0a" returned: 0 in 0.445s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Lock "cinder-quobyte-265a2372-59fd-47e2-bc4b-de8d7122cc0a" released by "delete_volume" :: held 1.008s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.quota [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Created reservations ['b9c40286-f1be-4bcc-a6d4-5cce4e801123', 'a46764d8-9333-4b50-9362-e5216df64bd0', '0ca7303f-fa12-401a-8f36-3e1d5ebeadff', 'b3a11bee-1534-4ea3-a432-f280492970ae'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:42 devstack sudo[85657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:42 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:42 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-596b1712-5a03-4bfa-8912-1a050c2bb28c" returned: 0 in 0.439s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Lock "cinder-quobyte-596b1712-5a03-4bfa-8912-1a050c2bb28c" released by "delete_volume" :: held 1.003s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:42 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Created reservations ['82658d0f-c8fd-457b-b1f9-3b74e95473d2', 'de28419a-f161-4eb0-ad32-9c6e836da455', '438590bb-409f-4017-9e6c-0416efb81d88', 'ed632607-787d-49d8-b742-0e37fba0a723'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:43 devstack sudo[85662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:43 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:43 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.433s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.manager [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Deleted volume successfully.
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-dc2fab2d-e4d8-4995-9d23-9223efde6c7e req-2c6587d2-b035-4757-b4b3-2443556f1750 tempest-VolumesGetTestJSON-2145404780 None] Lock "cinder-265a2372-59fd-47e2-bc4b-de8d7122cc0a-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:43 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.437s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Deleted volume successfully.
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-64b090e7-3417-4132-bc2e-37e78052865e tempest-VolumesTestJSON-1077934086 None] Lock "cinder-596b1712-5a03-4bfa-8912-1a050c2bb28c-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Flow 'volume_create_manager' (13b2d31b-3532-4d49-94bd-6f628d9ee519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee0f4f1-6a87-4aac-98aa-d85277bf1e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee0f4f1-6a87-4aac-98aa-d85277bf1e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1020860190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22423eed-873e-406b-b4f2-440df0eef737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b31be15e9b241f9ae6d66436c181eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:44Z,use_quota=True,user_id='ada8043052ce42b3ac8b0375d5b7e774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e06c6c4-3b80-41a0-8dd9-30ba3f8ccee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e06c6c4-3b80-41a0-8dd9-30ba3f8ccee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a133f3-f889-4753-a95a-8fb11aa03a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a133f3-f889-4753-a95a-8fb11aa03a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '22423eed-873e-406b-b4f2-440df0eef737', 'volume_name': 'volume-22423eed-873e-406b-b4f2-440df0eef737', 'volume_size': 2, 'source_volid': '0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4', 'source_volstatus': 'available'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb2da5d-5d32-4171-95d4-a9c2378e78a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb2da5d-5d32-4171-95d4-a9c2378e78a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469969eb-2f38-49b2-9dc6-435512077d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:43 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Volume 22423eed-873e-406b-b4f2-440df0eef737: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-22423eed-873e-406b-b4f2-440df0eef737', 'volume_size': 2, 'source_volid': '0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4', 'source_volstatus': 'available'}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:43 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Cloning volume 0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 to volume 22423eed-873e-406b-b4f2-440df0eef737
Feb 28 01:23:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Creating offline snapshot 8bc66aa5-6e96-44ad-94d1-c4e355793bc7 of volume 0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[db94e7c5-09b2-4323-bb0b-626e9ee5b0ae]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Acquiring lock "cinder-a21f54e9-c225-4c7a-bbc6-94f443ba2900-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:44 devstack sudo[85666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4
Feb 28 01:23:44 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Lock "cinder-a21f54e9-c225-4c7a-bbc6-94f443ba2900-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Acquiring lock "cinder-quobyte-a21f54e9-c225-4c7a-bbc6-94f443ba2900" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Lock "cinder-quobyte-a21f54e9-c225-4c7a-bbc6-94f443ba2900" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dd3510-6a54-49b9-9206-6f5b10bac61f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:44 devstack sudo[85668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900
Feb 28 01:23:44 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:44 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4" returned: 0 in 0.526s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:44 devstack sudo[85688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 1G
Feb 28 01:23:44 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:44 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900" returned: 0 in 0.742s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:44 devstack sudo[85702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900
Feb 28 01:23:44 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:45 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 1G" returned: 0 in 1.001s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:45 devstack sudo[85708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7
Feb 28 01:23:45 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:45 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a21f54e9-c225-4c7a-bbc6-94f443ba2900" returned: 0 in 0.902s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Lock "cinder-quobyte-a21f54e9-c225-4c7a-bbc6-94f443ba2900" released by "delete_volume" :: held 1.679s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Created reservations ['094c7c5b-adce-440b-90d8-c12dd93477b8', '59aa4ef5-b70e-4c5c-b777-3e6564cca4e9', 'bbc7f7dc-ec77-44f9-869d-fb1f470456a7', '56db74c8-c194-441e-8022-fbe576fbe4a6'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:45 devstack sudo[85710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:45 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:46 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7" returned: 0 in 1.401s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:46 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 is being set with open permissions: ugo+rw
Feb 28 01:23:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:47 devstack sudo[85716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7
Feb 28 01:23:47 devstack sudo[85716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:47 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 1.520s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:47 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:47 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Deleted volume successfully.
Feb 28 01:23:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3de1a1f5-8ef0-433f-abc2-f0ad0803999c tempest-VolumesTestJSON-1077934086 None] Lock "cinder-a21f54e9-c225-4c7a-bbc6-94f443ba2900-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:47 devstack sudo[85716]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7" returned: 0 in 0.868s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:47 devstack sudo[85721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.info
Feb 28 01:23:47 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:48 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.info" returned: 0 in 0.659s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:48 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.info is being set with open permissions: ugo+rw
Feb 28 01:23:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:48 devstack sudo[85725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.info
Feb 28 01:23:48 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:49 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.info" returned: 0 in 0.962s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Acquiring lock "cinder-quobyte-22423eed-873e-406b-b4f2-440df0eef737" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Lock "cinder-quobyte-22423eed-873e-406b-b4f2-440df0eef737" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] snapshot: 8bc66aa5-6e96-44ad-94d1-c4e355793bc7, volume: 22423eed-873e-406b-b4f2-440df0eef737,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38f1505-13a3-420f-be67-9b69216fd739]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:49 devstack sudo[85728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7
Feb 28 01:23:49 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:50 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7" returned: 0 in 0.722s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:23:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:23:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:23:50 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a4ec14-a89e-4d5b-940f-7a8871f916ad]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:50 devstack sudo[85733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4
Feb 28 01:23:50 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:50 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-51a069f8-21eb-48bb-8c73-948dfe782102 tempest-GroupSnapshotsTest-267922844 None] Group tempest-GroupSnapshotsTest-Group-620763588: creating
Feb 28 01:23:50 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-51a069f8-21eb-48bb-8c73-948dfe782102 tempest-GroupSnapshotsTest-267922844 None] Group tempest-GroupSnapshotsTest-Group-620763588: created successfully
Feb 28 01:23:50 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-51a069f8-21eb-48bb-8c73-948dfe782102 tempest-GroupSnapshotsTest-267922844 None] Create group completed successfully.
Feb 28 01:23:50 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4" returned: 0 in 0.757s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:50 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737 not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:23:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:51 devstack sudo[85738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737
Feb 28 01:23:51 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Flow 'volume_create_manager' (bfaeb9d8-5bc2-4c3d-b501-c49963d9511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3f35b3-0e2c-47ce-89ba-c29d57edd378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3f35b3-0e2c-47ce-89ba-c29d57edd378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1488519861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7fae9e54-2cd1-474c-a986-b450e7d569d9,host='devstack@QuobyteHD#QuobyteHD',id=4ab9b32d-c17e-48a3-973c-5107c4a53e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef318ea3ebc44cecadaf0450a23cca59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:53Z,use_quota=True,user_id='7ad5b69eac27488cab75562b90640b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(773cfb58-229e-4a61-8e9c-334f8313c444),volume_type_id=773cfb58-229e-4a61-8e9c-334f8313c444)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4cabf0-b9e3-4ee0-b020-bc90bb5a9b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4cabf0-b9e3-4ee0-b020-bc90bb5a9b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747979ac-5751-4c6c-b007-84f8f33af4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747979ac-5751-4c6c-b007-84f8f33af4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab9b32d-c17e-48a3-973c-5107c4a53e56', 'volume_name': 'volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29667ec7-da90-43fe-a647-a479aa126dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29667ec7-da90-43fe-a647-a479aa126dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0740a932-1758-415d-87ae-6eb03c0f686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:53 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Volume 4ab9b32d-c17e-48a3-973c-5107c4a53e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56', 'volume_size': 1}
Feb 28 01:23:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:54 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737" returned: 0 in 3.205s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9d374b-faf4-4eb5-bf07-cab1bfe72999]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:54 devstack sudo[85790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:54 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:54 devstack sudo[85789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4
Feb 28 01:23:54 devstack sudo[85789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:54 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.555s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:54 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:23:55 devstack sudo[85789]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4" returned: 0 in 0.805s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4, size 1024.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:23:55 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Converted 1024.00 MB image at 319.45 MB/s
Feb 28 01:23:55 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737 is being set with open permissions: ugo+rw
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:55 devstack sudo[85811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737
Feb 28 01:23:55 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:55 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737" returned: 0 in 0.495s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Lock "cinder-quobyte-22423eed-873e-406b-b4f2-440df0eef737" released by "_copy_volume_from_snapshot" :: held 6.033s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Acquiring lock "cinder-quobyte-8bc66aa5-6e96-44ad-94d1-c4e355793bc7" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Lock "cinder-quobyte-8bc66aa5-6e96-44ad-94d1-c4e355793bc7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Deleting offline snapshot 8bc66aa5-6e96-44ad-94d1-c4e355793bc7 of volume 0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] snapshot_file for this snap is: volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6262e4a-a51c-4d46-8402-fa10a7e491db]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:55 devstack sudo[85820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7
Feb 28 01:23:55 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:56 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7" returned: 0 in 0.515s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63425ac-bb5d-49d2-a80e-2d35221f2a57]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:56 devstack sudo[85825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4
Feb 28 01:23:56 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:23:56 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Flow 'volume_create_manager' (b82e0424-3a07-4cf4-be7f-ad63f0eb4621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20994721-cba5-42a6-a9fa-d553c88747ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4" returned: 0 in 0.596s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:56 devstack sudo[85832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7
Feb 28 01:23:56 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20994721-cba5-42a6-a9fa-d553c88747ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2105024365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc48448-98f0-403c-96c5-3e38ea0eb908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d924b57cbd1f483c8c1daf9dff498679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:57Z,use_quota=True,user_id='a9fd887074a648e899815bf4c18ed150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daede7cb-c43e-4900-9d8f-0b6609fe7636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daede7cb-c43e-4900-9d8f-0b6609fe7636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1cd1ce-0f37-41e7-a903-d91086e20aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.image.glance [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Creating Keystone auth plugin from conf {{(pid=82470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1cd1ce-0f37-41e7-a903-d91086e20aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cfc48448-98f0-403c-96c5-3e38ea0eb908', 'volume_name': 'volume-cfc48448-98f0-403c-96c5-3e38ea0eb908', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc5f3cc70>}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fc205d-f1e8-4361-bd75-b14ce27fbb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fc205d-f1e8-4361-bd75-b14ce27fbb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f3c899-2933-4191-a796-f9762ddcda7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:56 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Volume cfc48448-98f0-403c-96c5-3e38ea0eb908: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cfc48448-98f0-403c-96c5-3e38ea0eb908', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc5f3cc70>}
Feb 28 01:23:56 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Trying to clone cfc48448-98f0-403c-96c5-3e38ea0eb908 from image 9351240e-6df5-4131-8ea1-feeaf12d9c21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]). {{(pid=82470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 28 01:23:57 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Image download 20.69 MB at 20.69 MB/s
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8889170-5152-4da7-a42c-9a9b348bc584]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:57 devstack sudo[85837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD
Feb 28 01:23:57 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:57 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7" returned: 0 in 0.521s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:57 devstack sudo[85840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7
Feb 28 01:23:57 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:57 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Temporary image 9351240e-6df5-4131-8ea1-feeaf12d9c21 is fetched for user a9fd887074a648e899815bf4c18ed150. {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[03437996-bfc9-4ad5-9e13-d1c65594dfe9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:57 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4.8bc66aa5-6e96-44ad-94d1-c4e355793bc7" returned: 0 in 0.433s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Lock "cinder-quobyte-8bc66aa5-6e96-44ad-94d1-c4e355793bc7" released by "_delete_snapshot" :: held 2.126s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.725s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.224s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7fae9e54-2cd1-474c-a986-b450e7d569d9,created_at=2026-02-28T00:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1488519861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7fae9e54-2cd1-474c-a986-b450e7d569d9,host='devstack@QuobyteHD#QuobyteHD',id=4ab9b32d-c17e-48a3-973c-5107c4a53e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef318ea3ebc44cecadaf0450a23cca59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:53Z,use_quota=True,user_id='7ad5b69eac27488cab75562b90640b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(773cfb58-229e-4a61-8e9c-334f8313c444),volume_type_id=773cfb58-229e-4a61-8e9c-334f8313c444)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Creating volume 4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:57 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:57 devstack sudo[85846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD
Feb 28 01:23:57 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469969eb-2f38-49b2-9dc6-435512077d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22423eed-873e-406b-b4f2-440df0eef737', 'volume_size': 2, 'source_volid': '0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4', 'source_volstatus': 'available'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:57 devstack sudo[85847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 1073741824
Feb 28 01:23:57 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ba5ff0-5048-40f2-b9dd-3c1adaf2f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:57 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Volume volume-22423eed-873e-406b-b4f2-440df0eef737 (22423eed-873e-406b-b4f2-440df0eef737): created successfully
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ba5ff0-5048-40f2-b9dd-3c1adaf2f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Flow 'volume_create_manager' (13b2d31b-3532-4d49-94bd-6f628d9ee519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:57 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-63203ae6-5fba-4fff-8562-7ba4961792fe tempest-VolumesCloneTest-1566530466 None] Created volume successfully.
Feb 28 01:23:58 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:58 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 1073741824" returned: 0 in 0.534s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:58 devstack sudo[85856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56
Feb 28 01:23:58 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Acquiring lock "cinder-22423eed-873e-406b-b4f2-440df0eef737-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Lock "cinder-22423eed-873e-406b-b4f2-440df0eef737-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Acquiring lock "cinder-quobyte-22423eed-873e-406b-b4f2-440df0eef737" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Lock "cinder-quobyte-22423eed-873e-406b-b4f2-440df0eef737" acquired by "delete_volume" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[614655ef-d3af-4afd-91e6-e1ed073de6dd]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:58 devstack sudo[85858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737
Feb 28 01:23:58 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:58 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56" returned: 0 in 0.397s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2105024365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc48448-98f0-403c-96c5-3e38ea0eb908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d924b57cbd1f483c8c1daf9dff498679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:23:57Z,use_quota=True,user_id='a9fd887074a648e899815bf4c18ed150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Creating volume cfc48448-98f0-403c-96c5-3e38ea0eb908 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:23:58 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:58 devstack sudo[85861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 1073741824
Feb 28 01:23:58 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0740a932-1758-415d-87ae-6eb03c0f686b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2e7862-11d8-4cc9-9cfd-b23816ccf71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:23:58 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Volume volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 (4ab9b32d-c17e-48a3-973c-5107c4a53e56): created successfully
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2e7862-11d8-4cc9-9cfd-b23816ccf71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Flow 'volume_create_manager' (bfaeb9d8-5bc2-4c3d-b501-c49963d9511b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:23:58 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-55e2b4b6-c223-4920-a86e-b84ff57411f9 tempest-GroupSnapshotsTest-267922844 None] Created volume successfully.
Feb 28 01:23:58 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737" returned: 0 in 0.478s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:58 devstack sudo[85866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737
Feb 28 01:23:58 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:59 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 1073741824" returned: 0 in 0.498s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:59 devstack sudo[85872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908
Feb 28 01:23:59 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:59 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-22423eed-873e-406b-b4f2-440df0eef737" returned: 0 in 0.452s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Lock "cinder-quobyte-22423eed-873e-406b-b4f2-440df0eef737" released by "delete_volume" :: held 0.963s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Created reservations ['412d74bd-a339-4430-81ba-fdbd2f9ba35b', '1202b9ec-a94f-4df2-a964-128836c9f604', 'c6b5d319-e33f-4600-8ebc-65ef78651cdd', '66d4f3a3-4fc7-410f-abc7-ebc74c1ddaa9'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:59 devstack sudo[85891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:23:59 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Acquiring lock "cinder-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Lock "cinder-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Acquiring lock "cinder-quobyte-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Lock "cinder-quobyte-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4" acquired by "delete_volume" :: waited 0.048s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4300a0-6318-4bc1-abcb-c27c98f81754]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:23:59 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908" returned: 0 in 0.734s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:23:59 devstack sudo[85903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4
Feb 28 01:23:59 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:23:59 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Attempting download of 9351240e-6df5-4131-8ea1-feeaf12d9c21 ((None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}])) to volume cfc48448-98f0-403c-96c5-3e38ea0eb908. {{(pid=82470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a376e-839b-4bc0-a2c1-0d44ea63025d]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_upn3z8u4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:00 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.779s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:00 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Deleted volume successfully.
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-95464992-2f01-46d1-a8cf-62b3dda87f5a tempest-VolumesCloneTest-1566530466 None] Lock "cinder-22423eed-873e-406b-b4f2-440df0eef737-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:00 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] GroupSnapshot ae544488-dfb6-41be-93cd-4b5e1d06adfa: creating.
Feb 28 01:24:00 devstack sudo[85906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_upn3z8u4
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Group snapshot ae544488-dfb6-41be-93cd-4b5e1d06adfa: creating. {{(pid=82470) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Creating offline snapshot bd84bb53-33c6-4550-9989-730586482633 of volume 4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:24:00 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabd1842-801d-4d09-8403-4a9d3f1ffd1e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:00 devstack sudo[85909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56
Feb 28 01:24:00 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:00 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4" returned: 0 in 0.872s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:00 devstack sudo[85914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4
Feb 28 01:24:00 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_upn3z8u4" returned: 0 in 0.910s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_upn3z8u4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:00 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:01 devstack sudo[85918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_upn3z8u4
Feb 28 01:24:01 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:01 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56" returned: 0 in 0.756s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:01 devstack sudo[85923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 1G
Feb 28 01:24:01 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:01 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4" returned: 0 in 0.613s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Lock "cinder-quobyte-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4" released by "delete_volume" :: held 1.562s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Created reservations ['aedee5f3-b7a4-4d03-a938-8c3c312aacb2', '787c6be5-84d4-4c3c-8b2b-ea7dc58d3eed', 'c943029b-b61c-40c6-b047-2d2e89bf364c', '4e466b34-d375-41bf-8a58-87bc48f7a5a5'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:01 devstack sudo[85928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:01 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:01 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_upn3z8u4" returned: 1 in 0.534s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_upn3z8u4' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96a2a4a-8f21-4a53-93ae-edb28b45e66b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:01 devstack sudo[85933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD
Feb 28 01:24:01 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:01 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 1G" returned: 0 in 0.538s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:01 devstack sudo[85935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633
Feb 28 01:24:01 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:01 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.600s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:01 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:01 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Deleted volume successfully.
Feb 28 01:24:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d9c1ecf5-ad82-42ab-81b3-2cde5e6604a3 tempest-VolumesCloneTest-1566530466 None] Lock "cinder-0aa0c2e4-18ad-4d77-a46f-59bddebf3bd4-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:02 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633" returned: 0 in 0.511s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:02 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:24:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:02 devstack sudo[85945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633
Feb 28 01:24:02 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:02 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:02 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] 9351240e-6df5-4131-8ea1-feeaf12d9c21 was qcow2, converting to raw {{(pid=82470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 28 01:24:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:02 devstack sudo[85947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908
Feb 28 01:24:02 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:02 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633" returned: 0 in 0.635s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:02 devstack sudo[85964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.info
Feb 28 01:24:02 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:03 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908" returned: 0 in 1.033s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:03 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_i9mhk5mddevstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:24:03 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Converted 112.00 MB image at 108.18 MB/s
Feb 28 01:24:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:03 devstack sudo[85967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 1G
Feb 28 01:24:03 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:03 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.info" returned: 0 in 0.620s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:03 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:24:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:03 devstack sudo[85969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.info
Feb 28 01:24:03 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:03 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 1G" returned: 0 in 0.625s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb83a44d-f2cb-447d-93e9-0d29de346406]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:04 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.info" returned: 0 in 0.653s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.767s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:04 devstack sudo[85999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908
Feb 28 01:24:04 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:04 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-39976143-1745-4d01-a490-c8edf1250ea6 tempest-GroupSnapshotsTest-267922844 None] group_snapshot ae544488-dfb6-41be-93cd-4b5e1d06adfa: created successfully
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Flow 'volume_create_manager' (2cc4ddcd-c43d-46a6-8ecd-0ce00266dc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff5df1a-d9de-4288-af2e-e8963952e851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff5df1a-d9de-4288-af2e-e8963952e851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-177626152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57265d5-1666-4eb7-bfde-144398a83711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612a7984defd49578ddd2aa114009697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:04Z,use_quota=True,user_id='52475aea0d974242b943d26945d1afaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41bde1f-a625-4ec1-8b3a-26ff158bce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41bde1f-a625-4ec1-8b3a-26ff158bce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82b5b2f-f027-45ea-b650-1c8142fbfdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82b5b2f-f027-45ea-b650-1c8142fbfdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57265d5-1666-4eb7-bfde-144398a83711', 'volume_name': 'volume-c57265d5-1666-4eb7-bfde-144398a83711', 'volume_size': 2}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c10ef5-33c1-4041-be4f-5d905c2bdcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c10ef5-33c1-4041-be4f-5d905c2bdcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a8cab6-5a60-4dbc-9a29-b7bf56ea9864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:04 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Volume c57265d5-1666-4eb7-bfde-144398a83711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57265d5-1666-4eb7-bfde-144398a83711', 'volume_size': 2}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-177626152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57265d5-1666-4eb7-bfde-144398a83711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612a7984defd49578ddd2aa114009697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:04Z,use_quota=True,user_id='52475aea0d974242b943d26945d1afaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Creating volume c57265d5-1666-4eb7-bfde-144398a83711 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:04 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711 2147483648 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:04 devstack sudo[86020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711 2147483648
Feb 28 01:24:04 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:04 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908" returned: 0 in 0.743s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:04 devstack sudo[86026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908
Feb 28 01:24:04 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:05 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711 2147483648" returned: 0 in 0.881s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:05 devstack sudo[86035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711
Feb 28 01:24:05 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:05 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908" returned: 1 in 0.695s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Downloaded image 9351240e-6df5-4131-8ea1-feeaf12d9c21 ((None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}])) to volume cfc48448-98f0-403c-96c5-3e38ea0eb908 successfully. {{(pid=82470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Temporary image 9351240e-6df5-4131-8ea1-feeaf12d9c21 for user a9fd887074a648e899815bf4c18ed150 is deleted. {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Marking volume cfc48448-98f0-403c-96c5-3e38ea0eb908 as bootable. {{(pid=82470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Copying metadata from image 9351240e-6df5-4131-8ea1-feeaf12d9c21 to cfc48448-98f0-403c-96c5-3e38ea0eb908. {{(pid=82470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Creating volume glance metadata for volume cfc48448-98f0-403c-96c5-3e38ea0eb908 backed by image 9351240e-6df5-4131-8ea1-feeaf12d9c21 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f3c899-2933-4191-a796-f9762ddcda7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc48448-98f0-403c-96c5-3e38ea0eb908', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc5f3cc70>}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab8aefc-8a7b-46e9-aa20-a93a1097d6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:05 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Volume volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 (cfc48448-98f0-403c-96c5-3e38ea0eb908): created successfully
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab8aefc-8a7b-46e9-aa20-a93a1097d6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Flow 'volume_create_manager' (b82e0424-3a07-4cf4-be7f-ad63f0eb4621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:05 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c3df25af-2c0b-4bb7-9262-4dfc895c1673 tempest-VolumesImageMetadata-1510202613 None] Created volume successfully.
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:05 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711" returned: 0 in 0.545s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.167s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-bd84bb53-33c6-4550-9989-730586482633-3efcd648-9249-42b5-815a-5a391f65c9c1" by "_create_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-bd84bb53-33c6-4550-9989-730586482633-3efcd648-9249-42b5-815a-5a391f65c9c1" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Creating volume 3efcd648-9249-42b5-815a-5a391f65c9c1 from snapshot bd84bb53-33c6-4550-9989-730586482633 {{(pid=82470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-3efcd648-9249-42b5-815a-5a391f65c9c1" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a8cab6-5a60-4dbc-9a29-b7bf56ea9864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57265d5-1666-4eb7-bfde-144398a83711', 'volume_size': 2}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e608385-3357-4a41-91a4-c5d4e3493e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-3efcd648-9249-42b5-815a-5a391f65c9c1" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] snapshot: bd84bb53-33c6-4550-9989-730586482633, volume: 3efcd648-9249-42b5-815a-5a391f65c9c1,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:05 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Volume volume-c57265d5-1666-4eb7-bfde-144398a83711 (c57265d5-1666-4eb7-bfde-144398a83711): created successfully
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e608385-3357-4a41-91a4-c5d4e3493e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Flow 'volume_create_manager' (2cc4ddcd-c43d-46a6-8ecd-0ce00266dc84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cce23cf-5649-43b0-8614-ed17c4ca9a1d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:06 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d8e8c0dd-47b7-4e93-a328-e80bcad4a4db tempest-VolumesCloneNegativeTest-2019173832 None] Created volume successfully.
Feb 28 01:24:06 devstack sudo[86038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633
Feb 28 01:24:06 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Acquiring lock "cinder-c57265d5-1666-4eb7-bfde-144398a83711-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Acquiring lock "cinder-cfc48448-98f0-403c-96c5-3e38ea0eb908-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Lock "cinder-cfc48448-98f0-403c-96c5-3e38ea0eb908-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Lock "cinder-c57265d5-1666-4eb7-bfde-144398a83711-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Acquiring lock "cinder-quobyte-cfc48448-98f0-403c-96c5-3e38ea0eb908" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Acquiring lock "cinder-quobyte-c57265d5-1666-4eb7-bfde-144398a83711" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Lock "cinder-quobyte-cfc48448-98f0-403c-96c5-3e38ea0eb908" acquired by "delete_volume" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Lock "cinder-quobyte-c57265d5-1666-4eb7-bfde-144398a83711" acquired by "delete_volume" :: waited 0.015s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfe1919-6015-4a69-8972-2b3ea4a5dcbf]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[def9cfa3-05d2-4dc2-81ad-f7a1827e0e22]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:06 devstack sudo[86045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908
Feb 28 01:24:06 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:06 devstack sudo[86044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711
Feb 28 01:24:06 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:06 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633" returned: 0 in 0.945s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e04f21-4761-4383-b76c-efb7bd6388d7]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:07 devstack sudo[86048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56
Feb 28 01:24:07 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:07 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908" returned: 0 in 0.605s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:07 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711" returned: 0 in 0.654s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:07 devstack sudo[86062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711
Feb 28 01:24:07 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:07 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908
Feb 28 01:24:07 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:07 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56" returned: 0 in 0.591s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:07 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1 not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:24:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:07 devstack sudo[86083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1
Feb 28 01:24:07 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:07 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c57265d5-1666-4eb7-bfde-144398a83711" returned: 0 in 0.510s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Lock "cinder-quobyte-c57265d5-1666-4eb7-bfde-144398a83711" released by "delete_volume" :: held 1.198s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:07 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Created reservations ['5479b42f-bb92-4683-ac92-356128b86455', '50215816-04f7-476e-974a-7dbaa14284a4', '8df0264e-54ba-4e4b-943a-b5b276ec891d', '14b55e64-2829-47ee-b9af-a080a7d3dd08'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:08 devstack sudo[86093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:08 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:08 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908" returned: 1 in 0.686s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:24:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:08 devstack sudo[86096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908
Feb 28 01:24:08 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:09 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 1.107s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:09 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Deleted volume successfully.
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c49e24c3-3c0d-437c-a851-d535a1150f1c tempest-VolumesCloneNegativeTest-2019173832 None] Lock "cinder-c57265d5-1666-4eb7-bfde-144398a83711-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:09 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cfc48448-98f0-403c-96c5-3e38ea0eb908" returned: 0 in 1.575s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Lock "cinder-quobyte-cfc48448-98f0-403c-96c5-3e38ea0eb908" released by "delete_volume" :: held 2.937s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Created reservations ['3e12e501-bb0a-4a63-83a5-09af9e97211c', 'd0b5e518-2d38-4587-8117-ce8157392617', 'c0acf83c-7e65-4924-b314-43f798e68946', '0ce0df72-7e28-41a3-836a-7b51c66ae4cd'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:10 devstack sudo[86114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:10 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:10 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1" returned: 0 in 2.540s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:10 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ae476b-7932-41df-9584-7362eebe15e2]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:10 devstack sudo[86116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56
Feb 28 01:24:10 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:10 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.652s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:10 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:10 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Deleted volume successfully.
Feb 28 01:24:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4e61c380-f0e0-42d8-bff5-7ae965ccd6db tempest-VolumesImageMetadata-1510202613 None] Lock "cinder-cfc48448-98f0-403c-96c5-3e38ea0eb908-delete_volume" released by "delete_volume" :: held 4.016s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:10 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56" returned: 0 in 0.851s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:10 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56, size 1024.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:24:10 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Converted 1024.00 MB image at 403.03 MB/s
Feb 28 01:24:10 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1 is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:24:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:10 devstack sudo[86123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1
Feb 28 01:24:10 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:11 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-26fcead3-bc33-41bd-9a4a-48eee110f8d4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Terminate volume connection completed successfully.
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-26fcead3-bc33-41bd-9a4a-48eee110f8d4 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Deleting attachment 01474289-d032-4449-aa12-5df832bcdf7d. {{(pid=82470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 28 01:24:11 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1" returned: 0 in 0.491s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-3efcd648-9249-42b5-815a-5a391f65c9c1" released by "_copy_volume_from_snapshot" :: held 5.511s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-bd84bb53-33c6-4550-9989-730586482633-3efcd648-9249-42b5-815a-5a391f65c9c1" released by "_create_volume_from_snapshot" :: held 5.541s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.552s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:11 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1fbbe03e-698e-4a8c-bca7-7fd323d41d58 tempest-GroupSnapshotsTest-267922844 None] Create group from source-snapshot-ae544488-dfb6-41be-93cd-4b5e1d06adfa completed successfully.
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "cinder-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "cinder-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "cinder-quobyte-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "cinder-quobyte-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9c7829-159a-4b91-8b34-6309d2047a70]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:12 devstack sudo[86127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea
Feb 28 01:24:12 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Flow 'volume_create_manager' (565eb8e4-40b3-450b-b3a0-4884dc409a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc02eb0-c20c-4d6a-9acb-ccf48dbe5e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc02eb0-c20c-4d6a-9acb-ccf48dbe5e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-16724129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffee191439e4f2aa77a25fdae582486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:12Z,use_quota=True,user_id='2dff0fc425e04ea69c0d5385c0662cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4adc76d-8027-40d1-9b2c-028cbdad6d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4adc76d-8027-40d1-9b2c-028cbdad6d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855b1a80-c011-4688-8088-8d765b64ae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855b1a80-c011-4688-8088-8d765b64ae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1dd08e2-cb0c-49a4-ba45-76e5a329b7ab', 'volume_name': 'volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f97eb8c-4e13-40a9-8c1e-9d768a6fab52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f97eb8c-4e13-40a9-8c1e-9d768a6fab52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf1f986-23fb-4a62-8a83-b92e8dec6876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:12 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Volume d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab', 'volume_size': 1}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-16724129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffee191439e4f2aa77a25fdae582486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:12Z,use_quota=True,user_id='2dff0fc425e04ea69c0d5385c0662cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Creating volume d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:12 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:12 devstack sudo[86129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab 1073741824
Feb 28 01:24:12 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:12 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" returned: 0 in 0.548s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:12 devstack sudo[86133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea
Feb 28 01:24:12 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-3efcd648-9249-42b5-815a-5a391f65c9c1" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-3efcd648-9249-42b5-815a-5a391f65c9c1" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4135b3dc-6a91-4f43-91b0-ff7f38493c98]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:12 devstack sudo[86138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1
Feb 28 01:24:12 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:12 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab 1073741824" returned: 0 in 0.645s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:12 devstack sudo[86140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab
Feb 28 01:24:12 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:13 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" returned: 1 in 0.697s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:13 devstack sudo[86145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea
Feb 28 01:24:13 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:13 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" returned: 0 in 0.458s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf1f986-23fb-4a62-8a83-b92e8dec6876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cfce5a-3684-403c-b347-d10ff7d86e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:13 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Volume volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab (d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab): created successfully
Feb 28 01:24:13 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cfce5a-3684-403c-b347-d10ff7d86e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Flow 'volume_create_manager' (565eb8e4-40b3-450b-b3a0-4884dc409a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1" returned: 0 in 0.663s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:13 devstack sudo[86151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1
Feb 28 01:24:13 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:13 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b568167f-da9d-49eb-9143-7c6b1bce9606 tempest-SnapshotMetadataTestJSON-1078442295 None] Created volume successfully.
Feb 28 01:24:13 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" returned: 0 in 0.475s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "cinder-quobyte-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea" released by "delete_volume" :: held 1.777s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.quota [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Created reservations ['2436d7d2-0dd9-4e40-8337-f7c411193599', 'ba34219e-babc-443f-892b-dcc6d6cf1713', '1bd50162-66cf-4e1b-83ff-1b4c69655b64', '119693a5-b305-407f-bb6e-e7a7bf6f2b5d'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Flow 'volume_create_manager' (b4ab4e8d-baa0-4600-9f53-7e589e92082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0534419b-39d8-4b96-9cb9-071d52ed4630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:13 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:13 devstack sudo[86155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:13 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-3efcd648-9249-42b5-815a-5a391f65c9c1" returned: 0 in 0.473s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0534419b-39d8-4b96-9cb9-071d52ed4630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1985204122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e078141b-7467-4500-9fc8-4de43891bd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a610a09b5304afe8a89a01cfebd6176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:14Z,use_quota=True,user_id='05d6a8c1654c4487beb2906b07eb4381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b218a18-c865-4b3c-9758-d66225bb0350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b218a18-c865-4b3c-9758-d66225bb0350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca87547e-4c94-4cde-836a-97073e42ec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca87547e-4c94-4cde-836a-97073e42ec8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e078141b-7467-4500-9fc8-4de43891bd08', 'volume_name': 'volume-e078141b-7467-4500-9fc8-4de43891bd08', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4677a5ff-950a-4714-a3be-39dacd62db69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4677a5ff-950a-4714-a3be-39dacd62db69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570b6ee5-351e-4aa4-ba55-576d803f92cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:13 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Volume e078141b-7467-4500-9fc8-4de43891bd08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e078141b-7467-4500-9fc8-4de43891bd08', 'volume_size': 1}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1985204122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e078141b-7467-4500-9fc8-4de43891bd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a610a09b5304afe8a89a01cfebd6176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:14Z,use_quota=True,user_id='05d6a8c1654c4487beb2906b07eb4381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Creating volume e078141b-7467-4500-9fc8-4de43891bd08 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:13 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-3efcd648-9249-42b5-815a-5a391f65c9c1" released by "delete_volume" :: held 1.202s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:13 devstack sudo[86157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08 1073741824
Feb 28 01:24:13 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Created reservations ['6f5fd1bf-6999-423e-a6e8-24f1d4b41cf1'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:13 devstack cinder-volume[82470]: WARNING cinder.quota [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-583683518 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-583683518, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:24:13 devstack cinder-volume[82470]: WARNING cinder.quota [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-583683518 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-583683518, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:24:13 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Created reservations ['e866562c-5408-43cd-a686-4dee07b30613', '752f95e7-677c-4dce-af64-e29f34a52ab6', '35863860-b800-4c05-9556-7c561ff12523', '698ad216-15c2-4b4f-bdb2-c10997403dbb'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:14 devstack sudo[86159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:14 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:14 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.412s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG cinder.manager [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:14 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Deleted volume successfully.
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-e99f9180-94d4-48a2-b2d4-30bdc78b7850 req-4a7813fe-ee56-4ce7-a777-2fa3ad15c179 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "cinder-fb7426b0-b7c7-4c5f-b4dc-50ee718d31ea-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:14 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.470s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:14 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-bd245f13-a529-4ba3-a3bd-ec97116468a4 tempest-GroupSnapshotsTest-267922844 None] Delete group completed successfully.
Feb 28 01:24:14 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08 1073741824" returned: 0 in 0.631s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:14 devstack sudo[86166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08
Feb 28 01:24:14 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:14 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] group_snapshot ae544488-dfb6-41be-93cd-4b5e1d06adfa: deleting
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] group_snapshot ae544488-dfb6-41be-93cd-4b5e1d06adfa: deleting {{(pid=82470) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-4ab9b32d-c17e-48a3-973c-5107c4a53e56" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:14 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-4ab9b32d-c17e-48a3-973c-5107c4a53e56" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-bd84bb53-33c6-4550-9989-730586482633" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08" returned: 0 in 0.458s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:24:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.613s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570b6ee5-351e-4aa4-ba55-576d803f92cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e078141b-7467-4500-9fc8-4de43891bd08', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2695cd-88a7-450c-82e0-2772e5052798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:15 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Volume volume-e078141b-7467-4500-9fc8-4de43891bd08 (e078141b-7467-4500-9fc8-4de43891bd08): created successfully
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2695cd-88a7-450c-82e0-2772e5052798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Flow 'volume_create_manager' (b4ab4e8d-baa0-4600-9f53-7e589e92082c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-bd84bb53-33c6-4550-9989-730586482633" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Deleting offline snapshot bd84bb53-33c6-4550-9989-730586482633 of volume 4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] snapshot_file for this snap is: volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:24:15 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d007c4e6-e4c2-472b-b6d3-a524ce2766e3 tempest-VolumesNegativeTest-1505791441 None] Created volume successfully.
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Creating offline snapshot 993d43dc-9670-4622-a7d1-07db7e9129ab of volume d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a28880a-279f-43c9-8b14-61ca0f64f790]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4ac20f-2306-41c9-b664-9cddbd5ef1b0]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:15 devstack sudo[86169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633
Feb 28 01:24:15 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:15 devstack sudo[86170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab
Feb 28 01:24:15 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:15 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:15 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633" returned: 0 in 0.578s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" returned: 0 in 0.576s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ccaedc-07ac-4133-8e6e-1adb40f17515]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:15 devstack sudo[86179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab 1G
Feb 28 01:24:15 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:15 devstack sudo[86180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56
Feb 28 01:24:15 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:16 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab 1G" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:16 devstack sudo[86189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab
Feb 28 01:24:16 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:16 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56" returned: 0 in 0.547s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:16 devstack sudo[86193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633
Feb 28 01:24:16 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:16 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab" returned: 0 in 0.557s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:16 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab is being set with open permissions: ugo+rw
Feb 28 01:24:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:16 devstack sudo[86226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab
Feb 28 01:24:16 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:16 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633" returned: 0 in 0.698s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:16 devstack sudo[86228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633
Feb 28 01:24:16 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:17 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab" returned: 0 in 0.541s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:17 devstack sudo[86233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.info
Feb 28 01:24:17 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:17 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56.bd84bb53-33c6-4550-9989-730586482633" returned: 0 in 0.485s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-bd84bb53-33c6-4550-9989-730586482633" released by "_delete_snapshot" :: held 2.372s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-4ab9b32d-c17e-48a3-973c-5107c4a53e56" released by "delete_snapshot" :: held 2.432s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:17 devstack cinder-volume[82470]: WARNING cinder.quota [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-583683518 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-583683518, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:24:17 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] Created reservations ['68bd13dc-3eb4-4a3e-8d73-1a9f6f31b111', 'd987e157-668c-4459-8995-2955197f8337', '0746663f-7999-4474-92f4-6d8c1a29682b', 'ad3c92d1-10a0-44b1-8f3a-841a9e62e262'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:17 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-691f6a4f-e691-41cb-994d-7657a217e32f tempest-GroupSnapshotsTest-267922844 None] group_snapshot ae544488-dfb6-41be-93cd-4b5e1d06adfa: deleted successfully
Feb 28 01:24:17 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.info" returned: 0 in 0.454s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:17 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.info is being set with open permissions: ugo+rw
Feb 28 01:24:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:17 devstack sudo[86236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.info
Feb 28 01:24:17 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:18 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.info" returned: 0 in 0.455s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.227s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:18 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4fe4e95e-58a1-435a-9913-15742ae9ce30 tempest-SnapshotMetadataTestJSON-1078442295 None] Create snapshot completed successfully
Feb 28 01:24:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-4ab9b32d-c17e-48a3-973c-5107c4a53e56" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-4ab9b32d-c17e-48a3-973c-5107c4a53e56" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:18 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d41e475-5ab8-4244-bb8c-88db41b91ce6]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:18 devstack sudo[86240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56
Feb 28 01:24:18 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:18 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56" returned: 0 in 0.514s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:18 devstack sudo[86245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56
Feb 28 01:24:18 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Acquiring lock "cinder-993d43dc-9670-4622-a7d1-07db7e9129ab-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "cinder-993d43dc-9670-4622-a7d1-07db7e9129ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Acquiring lock "cinder-quobyte-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "cinder-quobyte-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Acquiring lock "cinder-quobyte-993d43dc-9670-4622-a7d1-07db7e9129ab" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "cinder-quobyte-993d43dc-9670-4622-a7d1-07db7e9129ab" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Deleting offline snapshot 993d43dc-9670-4622-a7d1-07db7e9129ab of volume d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] snapshot_file for this snap is: volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1bdf71-3187-4a2e-b626-3ff3770458be]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:19 devstack sudo[86247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab
Feb 28 01:24:19 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:19 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4ab9b32d-c17e-48a3-973c-5107c4a53e56" returned: 0 in 0.446s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-4ab9b32d-c17e-48a3-973c-5107c4a53e56" released by "delete_volume" :: held 1.000s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Created reservations ['4978cfff-77bd-44c2-913a-9ca139af2f80'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:19 devstack cinder-volume[82470]: WARNING cinder.db.sqlalchemy.api [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-583683518']
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Created reservations ['ffedad24-8dbe-4682-b951-764dc8c4f872', 'b11d9a39-e10c-4c3c-a61a-4511a9f9a848', '75915254-bc9a-4fa6-ae25-c595a32ee1be', 'f96ca5e8-d7e3-4279-a9c2-6c7433bbb539'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:19 devstack sudo[86250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:19 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:19 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab" returned: 0 in 0.533s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faba3d1-6c2d-49cd-bf61-191426156c6d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:19 devstack sudo[86255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab
Feb 28 01:24:19 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:19 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.416s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:19 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:19 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8d330ece-4a06-45f9-a319-538d7d74ab69 tempest-GroupSnapshotsTest-267922844 None] Delete group completed successfully.
Feb 28 01:24:20 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" returned: 0 in 0.475s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:20 devstack sudo[86261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab
Feb 28 01:24:20 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:20 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab" returned: 0 in 0.526s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:20 devstack sudo[86266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab
Feb 28 01:24:20 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-894e4497-469b-45ae-b42d-5fa167720528 tempest-GroupSnapshotsTest-267922844 None] Group tempest-GroupSnapshotsTest-Group-1821018701: creating
Feb 28 01:24:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-894e4497-469b-45ae-b42d-5fa167720528 tempest-GroupSnapshotsTest-267922844 None] Group tempest-GroupSnapshotsTest-Group-1821018701: created successfully
Feb 28 01:24:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-894e4497-469b-45ae-b42d-5fa167720528 tempest-GroupSnapshotsTest-267922844 None] Create group completed successfully.
Feb 28 01:24:21 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab.993d43dc-9670-4622-a7d1-07db7e9129ab" returned: 0 in 0.527s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "cinder-quobyte-993d43dc-9670-4622-a7d1-07db7e9129ab" released by "_delete_snapshot" :: held 2.118s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "cinder-quobyte-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" released by "delete_snapshot" :: held 2.130s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:21 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Created reservations ['e8e51709-2b6e-4b0a-99df-82f3eb7b4aca', '3b7e25d5-66bc-4f29-bea0-6070c3fbabb4', '7907d2e2-5dcc-4fcc-9565-35d8aceee510', 'abb03475-6d83-4f90-9b51-c879e532d5a4'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:21 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Delete snapshot completed successfully.
Feb 28 01:24:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9d18511-df23-41df-a193-a4be13b9e4fd tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "cinder-993d43dc-9670-4622-a7d1-07db7e9129ab-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Flow 'volume_create_manager' (2bc9df15-e44c-44eb-bcf5-d50058e5b27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93556649-9d6e-47d8-af5c-7e94b7279063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93556649-9d6e-47d8-af5c-7e94b7279063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-529273447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=66dcb066-1e56-4c7f-976c-118a4f972844,host='devstack@QuobyteHD#QuobyteHD',id=d64d3cc4-53fc-4465-8e98-a8e74d7f1ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef318ea3ebc44cecadaf0450a23cca59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:22Z,use_quota=True,user_id='7ad5b69eac27488cab75562b90640b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25d0503e-4cd3-41de-8d71-48200acad348),volume_type_id=25d0503e-4cd3-41de-8d71-48200acad348)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b7e785-39f4-4efd-8e60-94bc5b39f641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b7e785-39f4-4efd-8e60-94bc5b39f641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5886aa-592d-4778-972e-2a847d3c4423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5886aa-592d-4778-972e-2a847d3c4423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64d3cc4-53fc-4465-8e98-a8e74d7f1ada', 'volume_name': 'volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04f0303-fcc4-4da5-af87-5a22e671bf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04f0303-fcc4-4da5-af87-5a22e671bf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5f41a1-1f79-4d1c-89e6-070202277e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:22 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Volume d64d3cc4-53fc-4465-8e98-a8e74d7f1ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada', 'volume_size': 1}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=66dcb066-1e56-4c7f-976c-118a4f972844,created_at=2026-02-28T00:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-529273447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=66dcb066-1e56-4c7f-976c-118a4f972844,host='devstack@QuobyteHD#QuobyteHD',id=d64d3cc4-53fc-4465-8e98-a8e74d7f1ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef318ea3ebc44cecadaf0450a23cca59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:22Z,use_quota=True,user_id='7ad5b69eac27488cab75562b90640b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25d0503e-4cd3-41de-8d71-48200acad348),volume_type_id=25d0503e-4cd3-41de-8d71-48200acad348)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Creating volume d64d3cc4-53fc-4465-8e98-a8e74d7f1ada {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:22 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:22 devstack sudo[86271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada 1073741824
Feb 28 01:24:22 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Acquiring lock "cinder-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "cinder-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Acquiring lock "cinder-quobyte-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "cinder-quobyte-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ede663-2c2c-4431-91a1-a0fcbdabcfc3]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:22 devstack sudo[86273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab
Feb 28 01:24:22 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:22 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada 1073741824" returned: 0 in 0.526s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:22 devstack sudo[86282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada
Feb 28 01:24:22 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:23 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" returned: 0 in 0.673s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:23 devstack sudo[86293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab
Feb 28 01:24:23 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:23 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" returned: 0 in 0.497s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5f41a1-1f79-4d1c-89e6-070202277e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26d13c6-db02-4f09-bbee-ab1c0182e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:23 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Volume volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada (d64d3cc4-53fc-4465-8e98-a8e74d7f1ada): created successfully
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26d13c6-db02-4f09-bbee-ab1c0182e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Flow 'volume_create_manager' (2bc9df15-e44c-44eb-bcf5-d50058e5b27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:23 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b8f64ae9-dc05-4813-8002-c4326b3ad7d6 tempest-GroupSnapshotsTest-267922844 None] Created volume successfully.
Feb 28 01:24:23 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" returned: 0 in 0.406s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "cinder-quobyte-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab" released by "delete_volume" :: held 1.107s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Created reservations ['67145665-fc76-436d-88b4-4ad16973b322', 'ca37bd2d-7624-44eb-a9a3-7bf376600936', '39ba9bf7-73dd-455d-a6db-d914b3b76b37', 'c7536882-53c3-41d9-80da-44d0b9b96f7f'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:23 devstack sudo[86302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:23 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:24 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.518s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:24 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Deleted volume successfully.
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3094c9a0-b3ca-4886-a817-491bf88b0be5 tempest-SnapshotMetadataTestJSON-1078442295 None] Lock "cinder-d1dd08e2-cb0c-49a4-ba45-76e5a329b7ab-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Flow 'volume_create_manager' (5fd3310d-1b1c-4100-a089-1b4ca41463b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe051d3c-a936-4eac-8911-906d19c46e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe051d3c-a936-4eac-8911-906d19c46e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1602837477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=66dcb066-1e56-4c7f-976c-118a4f972844,host='devstack@QuobyteHD#QuobyteHD',id=40aceb0e-7730-41fd-9b06-b7192b1c76c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef318ea3ebc44cecadaf0450a23cca59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:25Z,use_quota=True,user_id='7ad5b69eac27488cab75562b90640b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25d0503e-4cd3-41de-8d71-48200acad348),volume_type_id=25d0503e-4cd3-41de-8d71-48200acad348)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad62a5b9-0532-4738-88fb-b29697b70ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad62a5b9-0532-4738-88fb-b29697b70ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59659536-bbdc-4562-bc92-2d0efdf7e22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59659536-bbdc-4562-bc92-2d0efdf7e22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40aceb0e-7730-41fd-9b06-b7192b1c76c0', 'volume_name': 'volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f709cf-cf3c-4e28-8cb4-6de77f7f3342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f709cf-cf3c-4e28-8cb4-6de77f7f3342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bf8849-ec7e-471a-9a88-ef8c0e97476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:24 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Volume 40aceb0e-7730-41fd-9b06-b7192b1c76c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0', 'volume_size': 1}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=66dcb066-1e56-4c7f-976c-118a4f972844,created_at=2026-02-28T00:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1602837477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=66dcb066-1e56-4c7f-976c-118a4f972844,host='devstack@QuobyteHD#QuobyteHD',id=40aceb0e-7730-41fd-9b06-b7192b1c76c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef318ea3ebc44cecadaf0450a23cca59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:25Z,use_quota=True,user_id='7ad5b69eac27488cab75562b90640b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25d0503e-4cd3-41de-8d71-48200acad348),volume_type_id=25d0503e-4cd3-41de-8d71-48200acad348)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Creating volume 40aceb0e-7730-41fd-9b06-b7192b1c76c0 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:24 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:24:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:24 devstack sudo[86333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 1073741824
Feb 28 01:24:24 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:25 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 1073741824" returned: 0 in 0.603s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:25 devstack sudo[86338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0
Feb 28 01:24:25 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:25 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0" returned: 0 in 0.497s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:24:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bf8849-ec7e-471a-9a88-ef8c0e97476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892d9a9e-5f1b-4a87-a904-3af6029551d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:25 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Volume volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 (40aceb0e-7730-41fd-9b06-b7192b1c76c0): created successfully
Feb 28 01:24:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892d9a9e-5f1b-4a87-a904-3af6029551d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Flow 'volume_create_manager' (5fd3310d-1b1c-4100-a089-1b4ca41463b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:25 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7600b956-6c73-4019-8925-5f24aa6d3e0a tempest-GroupSnapshotsTest-267922844 None] Created volume successfully.
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Flow 'volume_create_manager' (5a6f42ce-2b59-42c8-9a3a-0568c333d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e33c9d1-1b02-43ca-9a1e-ec237f6464ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e33c9d1-1b02-43ca-9a1e-ec237f6464ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1734662393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d4a58b-a751-491b-bd9e-2b2b6c227f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd9736bc09e4b2493da8f5dd9ce039d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:26Z,use_quota=True,user_id='6d0cf698fcb24709bc66215eba1f2b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac5bfd8-8dee-4924-89e1-78857e64eb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac5bfd8-8dee-4924-89e1-78857e64eb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2501fd81-21f8-494f-85e6-a954ecbdd774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2501fd81-21f8-494f-85e6-a954ecbdd774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d4a58b-a751-491b-bd9e-2b2b6c227f6e', 'volume_name': 'volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c28c12f-bb6b-4bbe-b561-f053710d4d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c28c12f-bb6b-4bbe-b561-f053710d4d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1a684e-815d-44be-9b81-d5e9a7893385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:26 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Volume c2d4a58b-a751-491b-bd9e-2b2b6c227f6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e', 'volume_size': 1}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1734662393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d4a58b-a751-491b-bd9e-2b2b6c227f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd9736bc09e4b2493da8f5dd9ce039d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:26Z,use_quota=True,user_id='6d0cf698fcb24709bc66215eba1f2b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Creating volume c2d4a58b-a751-491b-bd9e-2b2b6c227f6e {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:26 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:26 devstack sudo[86345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e 1073741824
Feb 28 01:24:26 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-c0ad6257-23d9-47a1-bc04-b981468355a8 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Terminate volume connection completed successfully.
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-c0ad6257-23d9-47a1-bc04-b981468355a8 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Deleting attachment 115f3e8f-5f6f-4e69-873e-efd63aec6b2d. {{(pid=82470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 28 01:24:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e51f7cd6-c115-47ab-865d-61760c3ed546 tempest-GroupSnapshotsTest-267922844 None] Update group completed successfully.
Feb 28 01:24:26 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e 1073741824" returned: 0 in 0.561s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:26 devstack sudo[86350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e
Feb 28 01:24:26 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "cinder-f7cfb912-20fb-40a9-8342-422dbe52d6ab-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "cinder-f7cfb912-20fb-40a9-8342-422dbe52d6ab-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "cinder-quobyte-f7cfb912-20fb-40a9-8342-422dbe52d6ab" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "cinder-quobyte-f7cfb912-20fb-40a9-8342-422dbe52d6ab" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f5b32-5c69-4d74-a92d-f4ce14f28b02]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:27 devstack sudo[86375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab
Feb 28 01:24:27 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:27 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" returned: 0 in 0.557s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1a684e-815d-44be-9b81-d5e9a7893385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8693a2a-c2b4-4a8f-ab88-0b0e148fb99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:27 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Volume volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e (c2d4a58b-a751-491b-bd9e-2b2b6c227f6e): created successfully
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8693a2a-c2b4-4a8f-ab88-0b0e148fb99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Flow 'volume_create_manager' (5a6f42ce-2b59-42c8-9a3a-0568c333d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:27 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-900aaa1e-a7ae-489f-836e-a626ea4626c0 tempest-VolumesDeleteCascade-1221327582 None] Created volume successfully.
Feb 28 01:24:28 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-95191571-ab09-4ca9-8f53-ccc983f7b884 tempest-GroupSnapshotsTest-267922844 None] Update group completed successfully.
Feb 28 01:24:28 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab" returned: 0 in 0.797s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:28 devstack sudo[86383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab
Feb 28 01:24:28 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:28 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f7cfb912-20fb-40a9-8342-422dbe52d6ab" returned: 0 in 0.406s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "cinder-quobyte-f7cfb912-20fb-40a9-8342-422dbe52d6ab" released by "delete_volume" :: held 1.246s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG cinder.quota [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Created reservations ['5626ca93-079c-4fea-b5c6-b6b2d830689d', 'a393b0e2-0d05-47ba-ba57-e50a7ecc6274', '0ff631c1-4504-4463-ae76-19e607c05a6d', '39b580ad-5ee2-486b-b66b-7af7928187ec'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:28 devstack sudo[86386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:28 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Creating offline snapshot 87dc11ac-7787-4f90-8fa8-d59965a5460d of volume c2d4a58b-a751-491b-bd9e-2b2b6c227f6e {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2373cad9-f3d1-4e28-94a4-f0c7e11944f5]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:28 devstack sudo[86388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e
Feb 28 01:24:28 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:29 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.460s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:29 devstack cinder-volume[82470]: DEBUG cinder.manager [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:29 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Deleted volume successfully.
Feb 28 01:24:29 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-de70ebcc-bcb1-4beb-9aba-50e914e8f0f0 req-78cacf60-eb88-4ee1-9ac0-05ee6ea70221 tempest-ServerBootFromVolumeStableRescueTest-1226290278 None] Lock "cinder-f7cfb912-20fb-40a9-8342-422dbe52d6ab-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:29 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2a72022b-c53f-4d4c-86ef-b589b2751dd8 tempest-GroupSnapshotsTest-267922844 None] Update group completed successfully.
Feb 28 01:24:29 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" returned: 0 in 0.585s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:29 devstack sudo[86394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d 1G
Feb 28 01:24:29 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:29 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d 1G" returned: 0 in 0.600s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:29 devstack sudo[86399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d
Feb 28 01:24:29 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:30 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-f77df669-ca16-4f42-927a-08dfdf43bcc0 tempest-GroupSnapshotsTest-267922844 None] Update group completed successfully.
Feb 28 01:24:30 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d" returned: 0 in 0.505s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:30 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d is being set with open permissions: ugo+rw
Feb 28 01:24:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:30 devstack sudo[86404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d
Feb 28 01:24:30 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:30 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d" returned: 0 in 0.423s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:30 devstack sudo[86412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.info
Feb 28 01:24:30 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:31 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.info" returned: 0 in 0.445s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:31 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.info is being set with open permissions: ugo+rw
Feb 28 01:24:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:31 devstack sudo[86431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.info
Feb 28 01:24:31 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:31 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] GroupSnapshot ca19c2b6-12cd-493c-a026-2343548d48d7: creating.
Feb 28 01:24:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Group snapshot ca19c2b6-12cd-493c-a026-2343548d48d7: creating. {{(pid=82470) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 28 01:24:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:31 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.info" returned: 0 in 0.556s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.175s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.230s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Creating offline snapshot 97c65031-436b-45c7-9ba7-474e253430cc of volume d64d3cc4-53fc-4465-8e98-a8e74d7f1ada {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:24:31 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-6f3418a9-c01b-4cd9-91f9-e3690973891b tempest-VolumesDeleteCascade-1221327582 None] Create snapshot completed successfully
Feb 28 01:24:31 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d8b184-46b7-4043-af59-61d83526c9c2]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:32 devstack sudo[86457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada
Feb 28 01:24:32 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:32 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" returned: 0 in 0.564s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:32 devstack sudo[86464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc 1G
Feb 28 01:24:32 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:33 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc 1G" returned: 0 in 0.521s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:33 devstack sudo[86469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc
Feb 28 01:24:33 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:33 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc" returned: 0 in 0.505s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:33 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:24:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:33 devstack sudo[86475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc
Feb 28 01:24:33 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:33 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc" returned: 0 in 0.416s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:33 devstack sudo[86478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.info
Feb 28 01:24:33 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:34 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.info" returned: 0 in 0.403s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:34 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:24:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:34 devstack sudo[86481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.info
Feb 28 01:24:34 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:34 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.info" returned: 0 in 0.422s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Creating offline snapshot b25efc10-e771-4363-8891-23ca191b508d of volume 40aceb0e-7730-41fd-9b06-b7192b1c76c0 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:24:34 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d1f507-5ccd-4f13-8fcf-6ed7f3984572]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:34 devstack sudo[86484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0
Feb 28 01:24:34 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:35 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0" returned: 0 in 0.476s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:35 devstack sudo[86490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d 1G
Feb 28 01:24:35 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:35 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d 1G" returned: 0 in 0.499s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:35 devstack sudo[86495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d
Feb 28 01:24:35 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:36 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d" returned: 0 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:36 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:24:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:36 devstack sudo[86500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d
Feb 28 01:24:36 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:36 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d" returned: 0 in 0.434s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:36 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:UPDATE=169,cinder:SELECT=156,cinder:DELETE=15,cinder:INSERT=50 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:24:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:36 devstack sudo[86503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.info
Feb 28 01:24:36 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:37 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.info" returned: 0 in 0.452s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:37 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:37 devstack sudo[86506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.info
Feb 28 01:24:37 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:37 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.info" returned: 0 in 0.427s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.586s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] Creating offline snapshot 06ae5e03-78c6-40f4-bbee-506a9fa689d6 of volume c2d4a58b-a751-491b-bd9e-2b2b6c227f6e {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7b3ab-d135-4d34-a847-cefa1e435702]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:37 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-02c1a4c4-76b5-4084-9500-3b028330e6fa tempest-GroupSnapshotsTest-267922844 None] group_snapshot ca19c2b6-12cd-493c-a026-2343548d48d7: created successfully
Feb 28 01:24:37 devstack sudo[86509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d
Feb 28 01:24:37 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:37 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] group_snapshot ca19c2b6-12cd-493c-a026-2343548d48d7: deleting
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] group_snapshot ca19c2b6-12cd-493c-a026-2343548d48d7: deleting {{(pid=82470) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-97c65031-436b-45c7-9ba7-474e253430cc" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-97c65031-436b-45c7-9ba7-474e253430cc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Deleting offline snapshot 97c65031-436b-45c7-9ba7-474e253430cc of volume d64d3cc4-53fc-4465-8e98-a8e74d7f1ada {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] snapshot_file for this snap is: volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53af30d-f37f-4809-9a69-e6b3db495262]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:38 devstack sudo[86511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc
Feb 28 01:24:38 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:38 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d" returned: 0 in 0.774s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:38 devstack sudo[86549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6 1G
Feb 28 01:24:38 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:38 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc" returned: 0 in 0.757s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e6890a-15b5-4562-b70e-059154769fa2]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:38 devstack sudo[86558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada
Feb 28 01:24:38 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:39 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6 1G" returned: 0 in 0.696s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:39 devstack sudo[86563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6
Feb 28 01:24:39 devstack sudo[86563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:39 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" returned: 0 in 0.539s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:39 devstack sudo[86568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc
Feb 28 01:24:39 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:39 devstack sudo[86563]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6" returned: 0 in 0.473s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:39 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6 is being set with open permissions: ugo+rw
Feb 28 01:24:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:39 devstack sudo[86573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6
Feb 28 01:24:39 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:39 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc" returned: 0 in 0.612s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:39 devstack sudo[86585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc
Feb 28 01:24:39 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:40 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6" returned: 0 in 0.537s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:40 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-158e77d4-ea9c-4a63-8189-25a48c67fb74 tempest-VolumesDeleteCascade-1221327582 None] Create snapshot completed successfully
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Performing cascade delete. {{(pid=82470) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-06ae5e03-78c6-40f4-bbee-506a9fa689d6-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-06ae5e03-78c6-40f4-bbee-506a9fa689d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-06ae5e03-78c6-40f4-bbee-506a9fa689d6" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-06ae5e03-78c6-40f4-bbee-506a9fa689d6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Deleting offline snapshot 06ae5e03-78c6-40f4-bbee-506a9fa689d6 of volume c2d4a58b-a751-491b-bd9e-2b2b6c227f6e {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] snapshot_file for this snap is: volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd6201f-00be-4151-888c-e89d4a683d13]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:40 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada.97c65031-436b-45c7-9ba7-474e253430cc" returned: 0 in 0.514s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-97c65031-436b-45c7-9ba7-474e253430cc" released by "_delete_snapshot" :: held 2.501s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" released by "delete_snapshot" :: held 2.513s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:40 devstack sudo[86590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6
Feb 28 01:24:40 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-40aceb0e-7730-41fd-9b06-b7192b1c76c0" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-40aceb0e-7730-41fd-9b06-b7192b1c76c0" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-b25efc10-e771-4363-8891-23ca191b508d" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-b25efc10-e771-4363-8891-23ca191b508d" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Deleting offline snapshot b25efc10-e771-4363-8891-23ca191b508d of volume 40aceb0e-7730-41fd-9b06-b7192b1c76c0 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] snapshot_file for this snap is: volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97b978a-aa0a-4b3d-93f4-592b98688e20]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:40 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d
Feb 28 01:24:40 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:41 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6" returned: 0 in 0.586s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bcd512-163b-4891-9cd2-385eddd66096]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:41 devstack sudo[86598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d
Feb 28 01:24:41 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:41 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d" returned: 0 in 0.610s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d973f40d-279b-4936-8f2c-0d98bba621f9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Acquiring lock "cinder-e078141b-7467-4500-9fc8-4de43891bd08-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Lock "cinder-e078141b-7467-4500-9fc8-4de43891bd08-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:UPDATE=176,cinder:DELETE=11,cinder:SELECT=171,cinder:INSERT=43 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Acquiring lock "cinder-quobyte-e078141b-7467-4500-9fc8-4de43891bd08" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:41 devstack sudo[86602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0
Feb 28 01:24:41 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Lock "cinder-quobyte-e078141b-7467-4500-9fc8-4de43891bd08" acquired by "delete_volume" :: waited 0.025s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fd2402-0ecf-4fc8-b4cd-3ac48f94679f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:41 devstack sudo[86604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08
Feb 28 01:24:41 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:41 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d" returned: 0 in 0.640s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:41 devstack sudo[86612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6
Feb 28 01:24:41 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:41 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0" returned: 0 in 0.541s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:41 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d
Feb 28 01:24:41 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:41 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08" returned: 0 in 0.534s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:41 devstack sudo[86620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08
Feb 28 01:24:41 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:42 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6" returned: 0 in 0.529s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:42 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d" returned: 0 in 0.495s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:42 devstack sudo[86628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6
Feb 28 01:24:42 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:42 devstack sudo[86629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d
Feb 28 01:24:42 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:42 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e078141b-7467-4500-9fc8-4de43891bd08" returned: 0 in 0.541s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Lock "cinder-quobyte-e078141b-7467-4500-9fc8-4de43891bd08" released by "delete_volume" :: held 1.107s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Created reservations ['0b690f15-4af3-4989-9072-b7c7c74db7cc', '07c7ff4b-5f08-4fe3-b8bf-bcba2d97a6e4', 'faf0fa72-df58-480a-b6ea-31dae3f76858', 'fb9a8e30-7de3-479f-814f-2907f3b79886'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:42 devstack sudo[86633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:42 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Flow 'volume_create_manager' (aad38e5b-6c7d-4bad-95b7-eea2f1b7d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797a56f7-d086-442d-8a23-731f60ca2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:42 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0.b25efc10-e771-4363-8891-23ca191b508d" returned: 0 in 0.502s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797a56f7-d086-442d-8a23-731f60ca2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2018543116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7524edeb-8db4-4d90-8e71-87992187dfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c871a0774643839c9be725aaa1be4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:43Z,use_quota=True,user_id='061d91454f494c8e8c66d0da10aaf580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d19392-15bf-49f0-8183-5928f565c850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d19392-15bf-49f0-8183-5928f565c850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8293c54-84d6-487d-a436-6a8aacc91488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8293c54-84d6-487d-a436-6a8aacc91488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7524edeb-8db4-4d90-8e71-87992187dfc6', 'volume_name': 'volume-7524edeb-8db4-4d90-8e71-87992187dfc6', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2653474-becb-4108-b7c1-e5cc4dd357d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2653474-becb-4108-b7c1-e5cc4dd357d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:42 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdccc880-05a3-431e-9164-914dbf552399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Volume 7524edeb-8db4-4d90-8e71-87992187dfc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7524edeb-8db4-4d90-8e71-87992187dfc6', 'volume_size': 1}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2018543116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7524edeb-8db4-4d90-8e71-87992187dfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c871a0774643839c9be725aaa1be4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:43Z,use_quota=True,user_id='061d91454f494c8e8c66d0da10aaf580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Creating volume 7524edeb-8db4-4d90-8e71-87992187dfc6 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:42 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-b25efc10-e771-4363-8891-23ca191b508d" released by "_delete_snapshot" :: held 2.243s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.06ae5e03-78c6-40f4-bbee-506a9fa689d6" returned: 0 in 0.584s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:42 devstack sudo[86637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6 1073741824
Feb 28 01:24:42 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-40aceb0e-7730-41fd-9b06-b7192b1c76c0" released by "delete_snapshot" :: held 2.270s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-06ae5e03-78c6-40f4-bbee-506a9fa689d6" released by "_delete_snapshot" :: held 2.413s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" released by "delete_snapshot" :: held 2.430s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Created reservations ['0759daa4-e159-453e-ad79-0ad0e5a4b90f', '4cf921f8-cddc-4fdc-b279-8ab4a3d388c5', '7045eddc-93f2-4016-b7ab-d103abf7c707', 'b0c888ed-feff-4f97-b0db-71aa26a594b2'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:42 devstack cinder-volume[82470]: WARNING cinder.quota [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1839788057 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1839788057, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:24:42 devstack cinder-volume[82470]: WARNING cinder.quota [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1839788057 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1839788057, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Created reservations ['da225e24-1d91-4a53-8f24-0975eef11be4', 'af0534a6-6cfb-40ac-a61d-e7c3ecc15818', '9c3b95a1-2f59-463f-b02f-4068d63184d1', 'e2e39ef7-2c50-417f-a27d-0baa328186a2'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:42 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Delete snapshot completed successfully.
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-06ae5e03-78c6-40f4-bbee-506a9fa689d6-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-87dc11ac-7787-4f90-8fa8-d59965a5460d-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-87dc11ac-7787-4f90-8fa8-d59965a5460d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-87dc11ac-7787-4f90-8fa8-d59965a5460d" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-87dc11ac-7787-4f90-8fa8-d59965a5460d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Deleting offline snapshot 87dc11ac-7787-4f90-8fa8-d59965a5460d of volume c2d4a58b-a751-491b-bd9e-2b2b6c227f6e {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:24:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] snapshot_file for this snap is: volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[21510071-1b5b-4c0d-8fe3-0564121058a6]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] Created reservations ['4bab7a63-4712-4c09-bf62-ec3d8ec04247', 'c8009867-8d45-40f1-b66d-25b3fed3667f', 'ca3c5d9c-6a96-4945-a5da-8e8dd486419a', 'c9540322-98d8-4abe-97e1-1fc76f2425ec'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:43 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.499s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Deleted volume successfully.
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cce6ce83-8fa3-4ca6-84cc-946d2eaca9ab tempest-VolumesNegativeTest-1505791441 None] Lock "cinder-e078141b-7467-4500-9fc8-4de43891bd08-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-12b4b9dd-887e-455c-bea0-51beb6a8b87b tempest-GroupSnapshotsTest-267922844 None] group_snapshot ca19c2b6-12cd-493c-a026-2343548d48d7: deleted successfully
Feb 28 01:24:43 devstack sudo[86640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d
Feb 28 01:24:43 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:43 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6 1073741824" returned: 0 in 0.493s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:43 devstack sudo[86645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6
Feb 28 01:24:43 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-40aceb0e-7730-41fd-9b06-b7192b1c76c0" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:43 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d" returned: 0 in 0.619s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-40aceb0e-7730-41fd-9b06-b7192b1c76c0" acquired by "delete_volume" :: waited 0.023s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf1a937-0a32-4aca-af62-25c3d31e6ac0]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[414d12d3-54d2-4144-bf9f-3105bdd95600]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:43 devstack sudo[86650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e
Feb 28 01:24:43 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:43 devstack sudo[86651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0
Feb 28 01:24:43 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:43 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6" returned: 0 in 0.489s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdccc880-05a3-431e-9164-914dbf552399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7524edeb-8db4-4d90-8e71-87992187dfc6', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56387d05-23f8-48a8-9f8a-11f6a375299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:43 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Volume volume-7524edeb-8db4-4d90-8e71-87992187dfc6 (7524edeb-8db4-4d90-8e71-87992187dfc6): created successfully
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56387d05-23f8-48a8-9f8a-11f6a375299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Flow 'volume_create_manager' (aad38e5b-6c7d-4bad-95b7-eea2f1b7d776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-79b12b88-500a-49cc-9198-e4d99fc5dda5 req-daeafef0-02e1-4b84-8d7f-3fe2baf28801 tempest-VolumesSnapshotsTestJSON-87606649 None] Created volume successfully.
Feb 28 01:24:44 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0" returned: 0 in 0.519s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:44 devstack sudo[86661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0
Feb 28 01:24:44 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:44 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" returned: 0 in 0.563s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:44 devstack sudo[86663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d
Feb 28 01:24:44 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:44 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-40aceb0e-7730-41fd-9b06-b7192b1c76c0" returned: 0 in 0.442s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-40aceb0e-7730-41fd-9b06-b7192b1c76c0" released by "delete_volume" :: held 1.009s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8122ce33-4046-4da0-b02d-a5a5b0a43a2c]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:44 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d" returned: 0 in 0.526s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:44 devstack sudo[86670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d
Feb 28 01:24:44 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:44 devstack sudo[86669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada
Feb 28 01:24:44 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Creating offline snapshot 9a40f623-ed54-40fb-bc6d-8caa8482c13d of volume 7524edeb-8db4-4d90-8e71-87992187dfc6 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ab6175-4d81-4882-acc8-ebc67807c16e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:45 devstack sudo[86673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6
Feb 28 01:24:45 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:45 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" returned: 0 in 0.603s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:45 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e.87dc11ac-7787-4f90-8fa8-d59965a5460d" returned: 0 in 0.545s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:45 devstack sudo[86679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada
Feb 28 01:24:45 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-87dc11ac-7787-4f90-8fa8-d59965a5460d" released by "_delete_snapshot" :: held 2.326s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" released by "delete_snapshot" :: held 2.345s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Created reservations ['317bb609-eaa7-4db5-8534-fc59d681092e', '0ec5f6b9-fafe-406a-9820-df85bbc2096b', '7d2f7c4f-437a-4339-a277-027f78c32861', 'dfa06fae-8faa-4d48-8d81-444da84729d5'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:45 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Delete snapshot completed successfully.
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-87dc11ac-7787-4f90-8fa8-d59965a5460d-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Snapshots deleted, issuing volume delete {{(pid=82470) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc40c10-27cd-449f-81ae-ecc7ba682a97]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:45 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e
Feb 28 01:24:45 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:45 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6" returned: 0 in 0.615s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:45 devstack sudo[86686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d 1G
Feb 28 01:24:45 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:45 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" returned: 0 in 0.623s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-d64d3cc4-53fc-4465-8e98-a8e74d7f1ada" released by "delete_volume" :: held 1.254s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Created reservations ['370ead13-67a3-4cd7-afbe-9dc261cac909'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:45 devstack cinder-volume[82470]: WARNING cinder.quota [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1839788057 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1839788057, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:24:45 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Created reservations ['ba912da5-b06d-4fee-9da8-092fd6bf9c12', '9dcda877-6de9-47ad-a6e4-e1fe1605b015', '189b914a-db33-483d-a4d3-e7f85b74d1b7', '97bc99ec-102e-468a-a686-de3465ec5958'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Created reservations ['bdaee995-e3c0-4eaa-a6fb-15db14f30bc8', '6a4e78ab-a4e6-4e3e-b800-aa67320debb6', 'f0eb57bb-c8a0-4214-8669-230cf7354e2c', '25cdfcef-2f19-44ff-9bf1-76727deb01e1'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:46 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" returned: 0 in 0.694s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:46 devstack sudo[86692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:46 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:46 devstack sudo[86694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e
Feb 28 01:24:46 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:46 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d 1G" returned: 0 in 0.527s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7524edeb-8db4-4d90-8e71-87992187dfc6 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:46 devstack sudo[86699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7524edeb-8db4-4d90-8e71-87992187dfc6 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d
Feb 28 01:24:46 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:46 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" returned: 0 in 0.429s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e" released by "delete_volume" :: held 1.166s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:46 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.470s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Created reservations ['9ddf1122-bad9-4107-905b-a3b7c158745f', 'd13005d5-09ea-4e99-9965-3501d9e3a04a', '0156b7f7-3864-4882-aba2-d3f5c728e3fb', 'b99d3a8a-8f71-426b-8a29-ab4cb3d60089'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:46 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-fc255d2f-5879-42b6-b752-1b8cd6d5a7d9 tempest-GroupSnapshotsTest-267922844 None] Delete group completed successfully.
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:46 devstack sudo[86706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:46 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:46 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7524edeb-8db4-4d90-8e71-87992187dfc6 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d" returned: 0 in 0.514s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:46 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d is being set with open permissions: ugo+rw
Feb 28 01:24:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:46 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d
Feb 28 01:24:46 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:47 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.470s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:47 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Deleted volume successfully.
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b864bb4-f9a2-4618-8aa1-7ba0f7b70697 tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-c2d4a58b-a751-491b-bd9e-2b2b6c227f6e-delete_volume" released by "delete_volume" :: held 6.878s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Flow 'volume_create_manager' (e4f2308b-2e79-43a5-ac25-0db8eebf7702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0919f34f-024f-4d54-b393-e490fcf51f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:47 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d" returned: 0 in 0.593s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:47 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-599f0154-fbfb-46c5-80a2-4e9a29bd7ddb tempest-GroupSnapshotsTest-267922844 None] Group tempest-GroupSnapshotsTest-Group-733212697: creating
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0919f34f-024f-4d54-b393-e490fcf51f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-270259730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31533114-d500-41b8-be81-ac1fdc8f72a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd9736bc09e4b2493da8f5dd9ce039d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:47Z,use_quota=True,user_id='6d0cf698fcb24709bc66215eba1f2b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee8ec0b-fe65-47d7-ba97-3cba398aedcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee8ec0b-fe65-47d7-ba97-3cba398aedcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e807039d-314b-4641-acef-bc4984476d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e807039d-314b-4641-acef-bc4984476d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31533114-d500-41b8-be81-ac1fdc8f72a8', 'volume_name': 'volume-31533114-d500-41b8-be81-ac1fdc8f72a8', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd20053-4ba5-488a-a09e-55858514a82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd20053-4ba5-488a-a09e-55858514a82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b6cbfc-46ab-447b-9c2f-14eb4390dca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:47 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Volume 31533114-d500-41b8-be81-ac1fdc8f72a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31533114-d500-41b8-be81-ac1fdc8f72a8', 'volume_size': 1}
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:47 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-599f0154-fbfb-46c5-80a2-4e9a29bd7ddb tempest-GroupSnapshotsTest-267922844 None] Group tempest-GroupSnapshotsTest-Group-733212697: created successfully
Feb 28 01:24:47 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-599f0154-fbfb-46c5-80a2-4e9a29bd7ddb tempest-GroupSnapshotsTest-267922844 None] Create group completed successfully.
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:47 devstack sudo[86713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.info
Feb 28 01:24:47 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:47 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.info" returned: 0 in 0.460s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:47 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.info is being set with open permissions: ugo+rw
Feb 28 01:24:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:47 devstack sudo[86717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.info
Feb 28 01:24:47 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:48 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.info" returned: 0 in 0.430s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.263s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.938s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-270259730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31533114-d500-41b8-be81-ac1fdc8f72a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd9736bc09e4b2493da8f5dd9ce039d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:47Z,use_quota=True,user_id='6d0cf698fcb24709bc66215eba1f2b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Creating volume 31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:48 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:48 devstack sudo[86720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 1073741824
Feb 28 01:24:48 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:48 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-63032ea3-48a6-4998-b3d7-63570cbf7e27 req-86018ffc-1b8d-44f7-9e46-c938a8decabd tempest-VolumesSnapshotsTestJSON-87606649 None] Create snapshot completed successfully
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Acquiring lock "cinder-9a40f623-ed54-40fb-bc6d-8caa8482c13d-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "cinder-9a40f623-ed54-40fb-bc6d-8caa8482c13d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Acquiring lock "cinder-quobyte-7524edeb-8db4-4d90-8e71-87992187dfc6" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "cinder-quobyte-7524edeb-8db4-4d90-8e71-87992187dfc6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Acquiring lock "cinder-quobyte-9a40f623-ed54-40fb-bc6d-8caa8482c13d" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "cinder-quobyte-9a40f623-ed54-40fb-bc6d-8caa8482c13d" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Deleting offline snapshot 9a40f623-ed54-40fb-bc6d-8caa8482c13d of volume 7524edeb-8db4-4d90-8e71-87992187dfc6 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] snapshot_file for this snap is: volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf1e283-ee6c-4888-917c-0ec50468f6ad]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Flow 'volume_create_manager' (866d2be3-a79e-4072-8ec9-12b5b70a56f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb3b807-13f6-4498-b333-b06de30d291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb3b807-13f6-4498-b333-b06de30d291c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1194045719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7ea5acc-69fe-454a-9bc7-d7c090b8f39b,host='devstack@QuobyteHD#QuobyteHD',id=28e769bd-bf47-4841-b236-81d539b414e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef318ea3ebc44cecadaf0450a23cca59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:49Z,use_quota=True,user_id='7ad5b69eac27488cab75562b90640b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac9de43b-1f9c-4cfd-9e24-e452c4c394b7),volume_type_id=ac9de43b-1f9c-4cfd-9e24-e452c4c394b7)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d0b926-11ed-4a71-ab9c-3fa624b2fd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d0b926-11ed-4a71-ab9c-3fa624b2fd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a749d302-cd35-4ba7-bdd3-4d9fcb2b1e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a749d302-cd35-4ba7-bdd3-4d9fcb2b1e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e769bd-bf47-4841-b236-81d539b414e2', 'volume_name': 'volume-28e769bd-bf47-4841-b236-81d539b414e2', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c49ac9-538c-412a-8bf6-8ae2c65739db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c49ac9-538c-412a-8bf6-8ae2c65739db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ef3172-dda6-476b-82a1-b1513fb156b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:48 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Volume 28e769bd-bf47-4841-b236-81d539b414e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e769bd-bf47-4841-b236-81d539b414e2', 'volume_size': 1}
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:48 devstack sudo[86722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d
Feb 28 01:24:48 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:48 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 1073741824" returned: 0 in 0.611s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:49 devstack sudo[86727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8
Feb 28 01:24:49 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:49 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d" returned: 0 in 0.566s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7524edeb-8db4-4d90-8e71-87992187dfc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d03381-8dbb-4675-ac40-b6413f5e3d59]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:49 devstack sudo[86732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6
Feb 28 01:24:49 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:49 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8" returned: 0 in 0.508s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a7ea5acc-69fe-454a-9bc7-d7c090b8f39b,created_at=2026-02-28T00:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1194045719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7ea5acc-69fe-454a-9bc7-d7c090b8f39b,host='devstack@QuobyteHD#QuobyteHD',id=28e769bd-bf47-4841-b236-81d539b414e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef318ea3ebc44cecadaf0450a23cca59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:49Z,use_quota=True,user_id='7ad5b69eac27488cab75562b90640b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac9de43b-1f9c-4cfd-9e24-e452c4c394b7),volume_type_id=ac9de43b-1f9c-4cfd-9e24-e452c4c394b7)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Creating volume 28e769bd-bf47-4841-b236-81d539b414e2 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:49 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b6cbfc-46ab-447b-9c2f-14eb4390dca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31533114-d500-41b8-be81-ac1fdc8f72a8', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475f1413-7fbf-4116-bbde-d7e734ebcb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:49 devstack sudo[86735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2 1073741824
Feb 28 01:24:49 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:49 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Volume volume-31533114-d500-41b8-be81-ac1fdc8f72a8 (31533114-d500-41b8-be81-ac1fdc8f72a8): created successfully
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475f1413-7fbf-4116-bbde-d7e734ebcb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Flow 'volume_create_manager' (e4f2308b-2e79-43a5-ac25-0db8eebf7702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:49 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-cccbf098-d90e-4948-9ef9-027f06c0a452 tempest-VolumesDeleteCascade-1221327582 None] Created volume successfully.
Feb 28 01:24:49 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6" returned: 0 in 0.598s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:49 devstack sudo[86740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d
Feb 28 01:24:49 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:50 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2 1073741824" returned: 0 in 0.671s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:50 devstack sudo[86745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2
Feb 28 01:24:50 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:50 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d" returned: 0 in 0.637s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:50 devstack sudo[86750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d
Feb 28 01:24:50 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:50 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2" returned: 0 in 0.619s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.150s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ef3172-dda6-476b-82a1-b1513fb156b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e769bd-bf47-4841-b236-81d539b414e2', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a339a4f-1808-4caa-b018-c292ceddc359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Creating offline snapshot 23920552-91be-4882-8ae6-fea70d5cbf71 of volume 31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:24:50 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Volume volume-28e769bd-bf47-4841-b236-81d539b414e2 (28e769bd-bf47-4841-b236-81d539b414e2): created successfully
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a339a4f-1808-4caa-b018-c292ceddc359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Flow 'volume_create_manager' (866d2be3-a79e-4072-8ec9-12b5b70a56f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9120c4-ce87-4428-ad88-d05c2ae18132]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:50 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d6878790-bbc5-4707-a116-af6d8595c747 tempest-GroupSnapshotsTest-267922844 None] Created volume successfully.
Feb 28 01:24:51 devstack sudo[86753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8
Feb 28 01:24:51 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:51 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6.9a40f623-ed54-40fb-bc6d-8caa8482c13d" returned: 0 in 0.597s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "cinder-quobyte-9a40f623-ed54-40fb-bc6d-8caa8482c13d" released by "_delete_snapshot" :: held 2.466s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "cinder-quobyte-7524edeb-8db4-4d90-8e71-87992187dfc6" released by "delete_snapshot" :: held 2.521s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.quota [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Created reservations ['ae36e9ad-68ed-4da3-9b49-935b61f0883d', 'b5af6bb2-48ca-4c38-8362-0a1a2c46f6b2', 'e69d4d3e-f1d7-4b35-9b2a-e4c8b93944eb', 'e026d5fa-fcab-4b92-b4ea-2e4ad84dd600'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:51 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Delete snapshot completed successfully.
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-2936eb91-09dc-410f-9085-9239d3b2a30b req-01624968-49db-46e0-8f3a-78fa3013015a tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "cinder-9a40f623-ed54-40fb-bc6d-8caa8482c13d-delete_snapshot" released by "delete_snapshot" :: held 2.621s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Flow 'volume_create_manager' (3714420a-2c74-4b92-b583-d2a81165ef0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0b6c58-da3e-4640-855d-d1966c0c188d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0b6c58-da3e-4640-855d-d1966c0c188d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-189554888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9774a2e9-9bbc-4a45-ad21-43399b84fd0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d089dfd720ee44809c26e4be447f95b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:51Z,use_quota=True,user_id='e8d945f70fdd46d1bb13c6a103bfda56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0b0630-7a88-44ef-8e0e-dff183318714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0b0630-7a88-44ef-8e0e-dff183318714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8017d6a3-0b5d-477c-9b0e-fc4f174bfcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8017d6a3-0b5d-477c-9b0e-fc4f174bfcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9774a2e9-9bbc-4a45-ad21-43399b84fd0a', 'volume_name': 'volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94137e02-479d-4baa-9623-cab5c51ce7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94137e02-479d-4baa-9623-cab5c51ce7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9517dfe9-1350-46df-bccc-26738c55f505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:51 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Volume 9774a2e9-9bbc-4a45-ad21-43399b84fd0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a', 'volume_size': 1}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:51 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8" returned: 0 in 0.569s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:51 devstack sudo[86759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 1G
Feb 28 01:24:51 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Acquiring lock "cinder-7524edeb-8db4-4d90-8e71-87992187dfc6-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "cinder-7524edeb-8db4-4d90-8e71-87992187dfc6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Acquiring lock "cinder-quobyte-7524edeb-8db4-4d90-8e71-87992187dfc6" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:52 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "cinder-quobyte-7524edeb-8db4-4d90-8e71-87992187dfc6" acquired by "delete_volume" :: waited 0.023s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 1G" returned: 0 in 0.513s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31533114-d500-41b8-be81-ac1fdc8f72a8 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[376eee0f-536b-4347-a84f-0bb3b0c02e32]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:52 devstack sudo[86765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31533114-d500-41b8-be81-ac1fdc8f72a8 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71
Feb 28 01:24:52 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:52 devstack sudo[86766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6
Feb 28 01:24:52 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:52 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] GroupSnapshot 19b6a35f-d79b-47f4-8ae3-768fc76f5657: creating.
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Group snapshot 19b6a35f-d79b-47f4-8ae3-768fc76f5657: creating. {{(pid=82470) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:52 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31533114-d500-41b8-be81-ac1fdc8f72a8 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71" returned: 0 in 0.458s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:52 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 is being set with open permissions: ugo+rw
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:52 devstack sudo[86775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71
Feb 28 01:24:52 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:52 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6" returned: 0 in 0.517s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:52 devstack sudo[86777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6
Feb 28 01:24:52 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:52 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71" returned: 0 in 0.388s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:52 devstack sudo[86781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.info
Feb 28 01:24:52 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:52 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7524edeb-8db4-4d90-8e71-87992187dfc6" returned: 0 in 0.409s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "cinder-quobyte-7524edeb-8db4-4d90-8e71-87992187dfc6" released by "delete_volume" :: held 0.964s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.quota [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Created reservations ['c2c290cf-d047-4f55-b4ff-376794508606', 'e514f6ac-b87e-4bf2-8c82-fc5e50a219c7', '2bcecaa7-27dc-4eae-8040-74636c30e701', '603338ab-8d8d-4fe2-8fcf-830a7adc2ce5'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:53 devstack sudo[86783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:53 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:53 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.info" returned: 0 in 0.479s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:53 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.info is being set with open permissions: ugo+rw
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:53 devstack sudo[86786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.info
Feb 28 01:24:53 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:53 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.477s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.manager [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:53 devstack cinder-volume[82470]: INFO cinder.volume.manager [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Deleted volume successfully.
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [req-538c11e2-d2a7-439a-b6e9-f17182f92d71 req-d389c0f2-c742-4437-9c5a-399bb4097cf3 tempest-VolumesSnapshotsTestJSON-87606649 None] Lock "cinder-7524edeb-8db4-4d90-8e71-87992187dfc6-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:24:53 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.info" returned: 0 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.998s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.445s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-189554888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9774a2e9-9bbc-4a45-ad21-43399b84fd0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d089dfd720ee44809c26e4be447f95b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:51Z,use_quota=True,user_id='e8d945f70fdd46d1bb13c6a103bfda56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Creating volume 9774a2e9-9bbc-4a45-ad21-43399b84fd0a {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:53 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:24:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:53 devstack sudo[86790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a 1073741824
Feb 28 01:24:53 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:53 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1a759976-c8a4-48f5-98f3-b0f2b17e7207 tempest-VolumesDeleteCascade-1221327582 None] Create snapshot completed successfully
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:54 devstack sudo[86792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:24:54 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:54 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a 1073741824" returned: 0 in 0.547s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:54 devstack sudo[86797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a
Feb 28 01:24:54 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:54 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.471s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:24:54 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" returned: 0 in 0.479s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.695s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9517dfe9-1350-46df-bccc-26738c55f505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b2c74-7730-48a2-8a89-884426e4527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Creating offline snapshot 9b203112-21a8-4f18-af99-9d2f32837284 of volume 28e769bd-bf47-4841-b236-81d539b414e2 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:24:54 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Volume volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a (9774a2e9-9bbc-4a45-ad21-43399b84fd0a): created successfully
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b2c74-7730-48a2-8a89-884426e4527b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Flow 'volume_create_manager' (3714420a-2c74-4b92-b583-d2a81165ef0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[216d9970-3faf-4981-88b9-fee9ee489972]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:55 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-64a034cb-a10e-42f3-a877-75915f00396c tempest-VolumesSnapshotTestJSON-1782731118 None] Created volume successfully.
Feb 28 01:24:55 devstack sudo[86801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2
Feb 28 01:24:55 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Flow 'volume_create_manager' (ccfd80e9-1c55-4114-9298-8f566c29baa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1149457d-2cba-4719-93f7-7f32e6476979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1149457d-2cba-4719-93f7-7f32e6476979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1574120492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0445a85-f834-41e6-9394-98dee751d589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd9736bc09e4b2493da8f5dd9ce039d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=23920552-91be-4882-8ae6-fea70d5cbf71,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:24:55Z,use_quota=True,user_id='6d0cf698fcb24709bc66215eba1f2b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e5bfab-4b47-4e3c-b61a-aa79950f341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e5bfab-4b47-4e3c-b61a-aa79950f341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac1a3e1-1d5e-47c3-afcf-53e30cbfa7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac1a3e1-1d5e-47c3-afcf-53e30cbfa7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd0445a85-f834-41e6-9394-98dee751d589', 'volume_name': 'volume-d0445a85-f834-41e6-9394-98dee751d589', 'volume_size': 1, 'snapshot_id': '23920552-91be-4882-8ae6-fea70d5cbf71'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7735970d-0ddb-4396-bf10-4c5ad5df2da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7735970d-0ddb-4396-bf10-4c5ad5df2da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b969450a-0b6c-4ae2-a23a-befd72d36b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:24:55 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Volume d0445a85-f834-41e6-9394-98dee751d589: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d0445a85-f834-41e6-9394-98dee751d589', 'volume_size': 1, 'snapshot_id': '23920552-91be-4882-8ae6-fea70d5cbf71'}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:55 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2" returned: 0 in 0.499s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:55 devstack sudo[86806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284 1G
Feb 28 01:24:55 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:55 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284 1G" returned: 0 in 0.505s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28e769bd-bf47-4841-b236-81d539b414e2 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:56 devstack sudo[86811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28e769bd-bf47-4841-b236-81d539b414e2 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284
Feb 28 01:24:56 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1484db3d-b692-4040-8c2d-73c731bdb6b8 tempest-BackendsCapabilitiesAdminTestsJSON-952552803 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580757141113, 'free_capacity_gb': 1775.7580757141113, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82470) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Feb 28 01:24:56 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28e769bd-bf47-4841-b236-81d539b414e2 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284" returned: 0 in 0.427s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:56 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284 is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:24:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:56 devstack sudo[86818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284
Feb 28 01:24:56 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2de742cd-e200-4db5-9733-7ef82a03a8ff tempest-BackendsCapabilitiesAdminTestsJSON-952552803 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580757141113, 'free_capacity_gb': 1775.7580757141113, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82470) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Feb 28 01:24:56 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284" returned: 0 in 0.427s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:56 devstack sudo[86823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.info
Feb 28 01:24:56 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:57 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.info" returned: 0 in 0.401s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:57 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:57 devstack sudo[86826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.info
Feb 28 01:24:57 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:57 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.info" returned: 0 in 0.439s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.777s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.529s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-23920552-91be-4882-8ae6-fea70d5cbf71-d0445a85-f834-41e6-9394-98dee751d589" by "_create_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-23920552-91be-4882-8ae6-fea70d5cbf71-d0445a85-f834-41e6-9394-98dee751d589" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Creating volume d0445a85-f834-41e6-9394-98dee751d589 from snapshot 23920552-91be-4882-8ae6-fea70d5cbf71 {{(pid=82470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-d0445a85-f834-41e6-9394-98dee751d589" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-d0445a85-f834-41e6-9394-98dee751d589" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] snapshot: 23920552-91be-4882-8ae6-fea70d5cbf71, volume: d0445a85-f834-41e6-9394-98dee751d589,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:24:57 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-019fc2a4-9eb1-499e-988e-c8961beb6bbf tempest-GroupSnapshotsTest-267922844 None] group_snapshot 19b6a35f-d79b-47f4-8ae3-768fc76f5657: created successfully
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e27022-b5e7-499f-aebb-6eb926b37416]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:57 devstack sudo[86829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71
Feb 28 01:24:57 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:58 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71" returned: 0 in 0.514s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31533114-d500-41b8-be81-ac1fdc8f72a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0d7c64-d828-45b7-b52c-12848eca86ad]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:58 devstack sudo[86834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8
Feb 28 01:24:58 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:58 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] group_snapshot 19b6a35f-d79b-47f4-8ae3-768fc76f5657: deleting
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] group_snapshot 19b6a35f-d79b-47f4-8ae3-768fc76f5657: deleting {{(pid=82470) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-28e769bd-bf47-4841-b236-81d539b414e2" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-28e769bd-bf47-4841-b236-81d539b414e2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-9b203112-21a8-4f18-af99-9d2f32837284" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-9b203112-21a8-4f18-af99-9d2f32837284" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Deleting offline snapshot 9b203112-21a8-4f18-af99-9d2f32837284 of volume 28e769bd-bf47-4841-b236-81d539b414e2 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] snapshot_file for this snap is: volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d8bf25-8038-4c7b-b6d1-ef4c51bc8606]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:58 devstack sudo[86836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284
Feb 28 01:24:58 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:58 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8" returned: 0 in 0.545s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589 not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:24:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:58 devstack sudo[86841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589
Feb 28 01:24:58 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:24:59 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root
Feb 28 01:24:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284" returned: 0 in 0.583s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:24:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28e769bd-bf47-4841-b236-81d539b414e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:24:59 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f83c33-d25d-410a-85cf-98e60696131d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:24:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:24:59 devstack sudo[86846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2
Feb 28 01:24:59 devstack sudo[86846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:00 devstack sudo[86846]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2" returned: 0 in 1.397s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:00 devstack sudo[86861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284
Feb 28 01:25:00 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:01 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589" returned: 0 in 2.159s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce2397-f762-402e-afaf-554afaa11e60]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:01 devstack sudo[86863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8
Feb 28 01:25:01 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Flow 'volume_create_manager' (990fda77-f5ff-4617-a9eb-9a2570ac02c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2567e4f3-19fb-482d-9d1a-93e0bff10e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2567e4f3-19fb-482d-9d1a-93e0bff10e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-324750548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd06ba8-d7c4-4483-851b-4e46c2863b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4572771c76bb49818c41dbb03b24c6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:01Z,use_quota=True,user_id='c0a3e6c03a9344a088f5569eb67a724c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f42c17-8258-4e94-bb59-7ad40650c5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f42c17-8258-4e94-bb59-7ad40650c5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723119d9-9d32-4656-9c40-90d7890a8756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723119d9-9d32-4656-9c40-90d7890a8756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd06ba8-d7c4-4483-851b-4e46c2863b47', 'volume_name': 'volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ac43a5-5f35-43ea-8629-f0bd61705c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ac43a5-5f35-43ea-8629-f0bd61705c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5783cfc8-0994-4741-a94a-af25aadbd45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:01 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47', 'volume_size': 1}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:01 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284" returned: 0 in 0.727s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:01 devstack sudo[86868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284
Feb 28 01:25:01 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:01 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8" returned: 0 in 0.597s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:25:01 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Converted 1024.00 MB image at 473.96 MB/s
Feb 28 01:25:01 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589 is being set with open permissions: ugo+rw
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:01 devstack sudo[86873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589
Feb 28 01:25:01 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:01 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2.9b203112-21a8-4f18-af99-9d2f32837284" returned: 0 in 0.396s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-9b203112-21a8-4f18-af99-9d2f32837284" released by "_delete_snapshot" :: held 3.172s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-28e769bd-bf47-4841-b236-81d539b414e2" released by "delete_snapshot" :: held 3.184s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:01 devstack cinder-volume[82470]: WARNING cinder.quota [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1934828024 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1934828024, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:25:01 devstack cinder-volume[82470]: WARNING cinder.quota [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1934828024 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1934828024, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:25:01 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] Created reservations ['c0f58e5e-deb1-4931-9714-077ba8cc1cf1', '489cca6d-b4a5-4df4-a9fd-541391dd74fc', '038c061c-cec2-4c1c-a829-4367d59bb862', 'a34b98af-bac6-4b1b-a2f2-70e93d9fe27c'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:01 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-aadfe7d6-598e-43bc-a179-e832e3f5e9ff tempest-GroupSnapshotsTest-267922844 None] group_snapshot 19b6a35f-d79b-47f4-8ae3-768fc76f5657: deleted successfully
Feb 28 01:25:02 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589" returned: 0 in 0.416s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-d0445a85-f834-41e6-9394-98dee751d589" released by "_copy_volume_from_snapshot" :: held 4.318s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-23920552-91be-4882-8ae6-fea70d5cbf71-d0445a85-f834-41e6-9394-98dee751d589" released by "_create_volume_from_snapshot" :: held 4.341s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.365s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.304s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Creating offline snapshot 65b5a364-5a18-4fe6-8530-5f512d53bbe5 of volume 9774a2e9-9bbc-4a45-ad21-43399b84fd0a {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4d12f0-09bb-4685-ae8f-2e13ff8ca5e3]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b969450a-0b6c-4ae2-a23a-befd72d36b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0445a85-f834-41e6-9394-98dee751d589', 'volume_size': 1, 'snapshot_id': '23920552-91be-4882-8ae6-fea70d5cbf71'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25698ac-15f3-46ec-b743-2fc838d6e091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:02 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Volume volume-d0445a85-f834-41e6-9394-98dee751d589 (d0445a85-f834-41e6-9394-98dee751d589): created successfully
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25698ac-15f3-46ec-b743-2fc838d6e091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Flow 'volume_create_manager' (ccfd80e9-1c55-4114-9298-8f566c29baa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:02 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8947c6cf-51ed-4025-839e-9f6c01dc027c tempest-VolumesDeleteCascade-1221327582 None] Created volume successfully.
Feb 28 01:25:02 devstack sudo[86878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a
Feb 28 01:25:02 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:02 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:02 devstack sudo[86883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5 1G
Feb 28 01:25:02 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-31533114-d500-41b8-be81-ac1fdc8f72a8-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-31533114-d500-41b8-be81-ac1fdc8f72a8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Performing cascade delete. {{(pid=82470) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-23920552-91be-4882-8ae6-fea70d5cbf71-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-23920552-91be-4882-8ae6-fea70d5cbf71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-31533114-d500-41b8-be81-ac1fdc8f72a8" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-31533114-d500-41b8-be81-ac1fdc8f72a8" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-23920552-91be-4882-8ae6-fea70d5cbf71" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-23920552-91be-4882-8ae6-fea70d5cbf71" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Deleting offline snapshot 23920552-91be-4882-8ae6-fea70d5cbf71 of volume 31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] snapshot_file for this snap is: volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac5b539-883e-4179-b8c6-242cd8a19c83]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:02 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71
Feb 28 01:25:02 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "cinder-quobyte-28e769bd-bf47-4841-b236-81d539b414e2" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-28e769bd-bf47-4841-b236-81d539b414e2" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:03 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5 1G" returned: 0 in 0.539s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[83341158-242d-4f49-9254-3b4ee7399238]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:03 devstack sudo[86890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5
Feb 28 01:25:03 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:03 devstack sudo[86891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2
Feb 28 01:25:03 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:03 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71" returned: 0 in 0.516s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31533114-d500-41b8-be81-ac1fdc8f72a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[862561da-dc75-4219-b63e-0eb84be179e6]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:03 devstack sudo[86897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8
Feb 28 01:25:03 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:03 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5" returned: 0 in 0.410s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:03 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5 is being set with open permissions: ugo+rw
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:03 devstack sudo[86904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5
Feb 28 01:25:03 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:03 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2" returned: 0 in 0.488s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:03 devstack sudo[86907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2
Feb 28 01:25:03 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:03 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8" returned: 0 in 0.479s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:03 devstack sudo[86912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71
Feb 28 01:25:03 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:03 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5" returned: 0 in 0.432s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:04 devstack sudo[86916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.info
Feb 28 01:25:04 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:04 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28e769bd-bf47-4841-b236-81d539b414e2" returned: 0 in 0.396s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Lock "cinder-quobyte-28e769bd-bf47-4841-b236-81d539b414e2" released by "delete_volume" :: held 0.936s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Created reservations ['ef9a52fb-7827-4a1b-8fe7-0edc90d01b34'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:04 devstack cinder-volume[82470]: WARNING cinder.quota [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1934828024 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1934828024, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Created reservations ['00e66bbc-5933-4a79-9368-242cd029c657', 'f67a0c42-7419-4629-9b27-f88af2a5c663', '96ff078f-ba13-4d78-a052-ddafd28ffe44', '183cc297-e5bb-46ee-bb88-687d508abf65'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:04 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:04 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:04 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:04 devstack sudo[86923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71
Feb 28 01:25:04 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:04 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.info" returned: 0 in 0.435s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:04 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.info is being set with open permissions: ugo+rw
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:04 devstack sudo[86926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.info
Feb 28 01:25:04 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:04 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.407s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:04 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5b3483a2-e9e3-4e60-885c-cd031e67cdef tempest-GroupSnapshotsTest-267922844 None] Delete group completed successfully.
Feb 28 01:25:04 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8.23920552-91be-4882-8ae6-fea70d5cbf71" returned: 0 in 0.409s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-23920552-91be-4882-8ae6-fea70d5cbf71" released by "_delete_snapshot" :: held 1.916s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-31533114-d500-41b8-be81-ac1fdc8f72a8" released by "delete_snapshot" :: held 1.927s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Created reservations ['66ad7407-0b54-42b4-923a-b7256baecd94', '7e82d33c-07f8-42da-93d8-5b1b87809be0', 'b8d4a785-cce7-4c04-8f72-0c7f9737fd3a', 'f519a086-9d08-4370-9939-b62b065c71bb'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:04 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Delete snapshot completed successfully.
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-23920552-91be-4882-8ae6-fea70d5cbf71-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Snapshots deleted, issuing volume delete {{(pid=82470) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-31533114-d500-41b8-be81-ac1fdc8f72a8" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-31533114-d500-41b8-be81-ac1fdc8f72a8" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b87ae3a-d0bc-44e0-8c2c-a488f8ded777]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:04 devstack sudo[86930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8
Feb 28 01:25:04 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:04 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.info" returned: 0 in 0.433s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.775s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.642s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-324750548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd06ba8-d7c4-4483-851b-4e46c2863b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4572771c76bb49818c41dbb03b24c6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:01Z,use_quota=True,user_id='c0a3e6c03a9344a088f5569eb67a724c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Creating volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:04 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:04 devstack sudo[86933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 1073741824
Feb 28 01:25:04 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:04 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4d9d426a-8caa-491e-93a8-250c30488922 tempest-VolumesSnapshotTestJSON-1782731118 None] Create snapshot completed successfully
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-65b5a364-5a18-4fe6-8530-5f512d53bbe5-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-65b5a364-5a18-4fe6-8530-5f512d53bbe5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:05 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8" returned: 0 in 0.516s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-65b5a364-5a18-4fe6-8530-5f512d53bbe5" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:05 devstack sudo[86940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8
Feb 28 01:25:05 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-65b5a364-5a18-4fe6-8530-5f512d53bbe5" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Deleting offline snapshot 65b5a364-5a18-4fe6-8530-5f512d53bbe5 of volume 9774a2e9-9bbc-4a45-ad21-43399b84fd0a {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] snapshot_file for this snap is: volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e6dede-b4b5-4e93-b166-d6dbe0fb150a]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:05 devstack sudo[86943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5
Feb 28 01:25:05 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:05 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 1073741824" returned: 0 in 0.535s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:05 devstack sudo[86945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47
Feb 28 01:25:05 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:05 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-31533114-d500-41b8-be81-ac1fdc8f72a8" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-31533114-d500-41b8-be81-ac1fdc8f72a8" released by "delete_volume" :: held 1.021s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Created reservations ['76c949cc-f2a3-4be9-9207-d44c048a82df', 'b57b4876-6ff4-4e2b-8671-1c2f8ef65729', 'c73f23eb-bcc5-4149-8463-d78ef915dad1', '2d28cd5d-37fc-46d8-a8b7-5d45b73fb9d1'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:05 devstack sudo[86951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:05 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:05 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5" returned: 0 in 0.575s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b021538-e694-4708-b5fe-4a873447143e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:06 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:06 devstack sudo[86954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a
Feb 28 01:25:06 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47" returned: 0 in 0.567s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-d0445a85-f834-41e6-9394-98dee751d589-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5783cfc8-0994-4741-a94a-af25aadbd45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a792a2-3a3d-4ae1-b031-db29af983c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-d0445a85-f834-41e6-9394-98dee751d589-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:06 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Volume volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 (0fd06ba8-d7c4-4483-851b-4e46c2863b47): created successfully
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a792a2-3a3d-4ae1-b031-db29af983c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Flow 'volume_create_manager' (990fda77-f5ff-4617-a9eb-9a2570ac02c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:06 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ae45bc61-54b9-4980-b2fc-85fe51f43ade tempest-SnapshotsActionsTest-1171305829 None] Created volume successfully.
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "cinder-quobyte-d0445a85-f834-41e6-9394-98dee751d589" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-d0445a85-f834-41e6-9394-98dee751d589" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c67743-e869-42ab-ad09-31780bc4b0dd]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:06 devstack sudo[86956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589
Feb 28 01:25:06 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:06 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.595s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:06 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Deleted volume successfully.
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13313354-4fdc-4c8e-89c1-875c2acaa25c tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-31533114-d500-41b8-be81-ac1fdc8f72a8-delete_volume" released by "delete_volume" :: held 3.777s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:06 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" returned: 0 in 0.535s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:06 devstack sudo[86962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5
Feb 28 01:25:06 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Creating offline snapshot 0222f3b4-ee72-478f-b508-6ca7e9c6b03b of volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab4e056-711e-4e73-96d8-7d4edc612c2b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:06 devstack sudo[87005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47
Feb 28 01:25:06 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:06 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589" returned: 0 in 0.720s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:06 devstack sudo[87112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589
Feb 28 01:25:06 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:07 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5" returned: 0 in 0.584s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:07 devstack sudo[87117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5
Feb 28 01:25:07 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:07 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47" returned: 0 in 0.612s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:07 devstack sudo[87123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b 1G
Feb 28 01:25:07 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:07 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d0445a85-f834-41e6-9394-98dee751d589" returned: 0 in 0.461s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-quobyte-d0445a85-f834-41e6-9394-98dee751d589" released by "delete_volume" :: held 1.207s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Created reservations ['570e2b86-2469-4ba6-b13c-5a4e595eb77e', 'c0d9d47b-6b17-48a0-976a-d8903719444b', 'b68ef7a6-971e-4273-9621-595a495c5288', '2e40db36-d223-4620-b256-31daa844d64f'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:07 devstack sudo[87125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:07 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:07 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a.65b5a364-5a18-4fe6-8530-5f512d53bbe5" returned: 0 in 0.494s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-65b5a364-5a18-4fe6-8530-5f512d53bbe5" released by "_delete_snapshot" :: held 2.265s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" released by "delete_snapshot" :: held 2.281s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Created reservations ['e12ca369-e64f-4542-b363-a9939a904320', '123b45ec-e13c-4d20-a633-8773849adb3d', '6fd6af64-71a7-4fe0-a727-848a4da0365d', '9cdc6f0f-2e0f-455b-bdec-7b3758c2b229'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:07 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Delete snapshot completed successfully.
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12b3c554-f778-4db5-afd7-4538164fb5b2 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-65b5a364-5a18-4fe6-8530-5f512d53bbe5-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:07 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b 1G" returned: 0 in 0.540s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:07 devstack sudo[87132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:07 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:07 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.463s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:07 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Deleted volume successfully.
Feb 28 01:25:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6f764e11-973e-46c7-b84a-558ae11a715e tempest-VolumesDeleteCascade-1221327582 None] Lock "cinder-d0445a85-f834-41e6-9394-98dee751d589-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:08 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.455s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:08 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b is being set with open permissions: ugo+rw
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:08 devstack sudo[87137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:08 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:08 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e81f4865-2836-4eda-aa93-8eaf43955e67 tempest-GroupSnapshotsV319Test-1570285261 None] Group tempest-GroupSnapshotsV319Test-Group-845732060: creating
Feb 28 01:25:08 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e81f4865-2836-4eda-aa93-8eaf43955e67 tempest-GroupSnapshotsV319Test-1570285261 None] Group tempest-GroupSnapshotsV319Test-Group-845732060: created successfully
Feb 28 01:25:08 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e81f4865-2836-4eda-aa93-8eaf43955e67 tempest-GroupSnapshotsV319Test-1570285261 None] Create group completed successfully.
Feb 28 01:25:08 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Flow 'volume_create_manager' (c4a4a7b8-83c2-4f3d-a731-068457b7672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19f0bac-da06-495a-aae7-b9382864978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19f0bac-da06-495a-aae7-b9382864978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-846498361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c5d434-7465-4c30-9d92-120d720ef3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d089dfd720ee44809c26e4be447f95b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:09Z,use_quota=True,user_id='e8d945f70fdd46d1bb13c6a103bfda56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d84298-384c-406c-af82-63d53262c937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d84298-384c-406c-af82-63d53262c937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e510987a-c99f-4406-822d-227ebd4f0299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e510987a-c99f-4406-822d-227ebd4f0299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c5d434-7465-4c30-9d92-120d720ef3f0', 'volume_name': 'volume-14c5d434-7465-4c30-9d92-120d720ef3f0', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf54bb7-3260-4aaa-9ed4-2ae5c0773f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf54bb7-3260-4aaa-9ed4-2ae5c0773f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10364d53-5474-4b92-a5ee-ee90ac18f1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:08 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Volume 14c5d434-7465-4c30-9d92-120d720ef3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c5d434-7465-4c30-9d92-120d720ef3f0', 'volume_size': 1}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.504s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:08 devstack sudo[87140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.info
Feb 28 01:25:08 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:09 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.info" returned: 0 in 0.426s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:09 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.info is being set with open permissions: ugo+rw
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:09 devstack sudo[87143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.info
Feb 28 01:25:09 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:09 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.info" returned: 0 in 0.415s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.046s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-846498361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c5d434-7465-4c30-9d92-120d720ef3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d089dfd720ee44809c26e4be447f95b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:09Z,use_quota=True,user_id='e8d945f70fdd46d1bb13c6a103bfda56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Creating volume 14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:09 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:09 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ef762e6b-65a7-48cd-aeed-54fe00b37eca tempest-SnapshotsActionsTest-1171305829 None] Create snapshot completed successfully
Feb 28 01:25:09 devstack sudo[87146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 1073741824
Feb 28 01:25:09 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Flow 'volume_create_manager' (b9c00d25-e96f-4779-affb-9404b5809b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4dbdd70-d8e3-40d2-9b5e-773f65d2cb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4dbdd70-d8e3-40d2-9b5e-773f65d2cb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-525739089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fc9090ea-44bf-4fe6-9090-0fc7c1f1ceaa,host='devstack@QuobyteHD#QuobyteHD',id=2cccff9c-eb27-4301-bdd4-4387a4b8447f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10a3b33940c4c1dbbfe91b947a753de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:10Z,use_quota=True,user_id='5389b820a6eb4d80879fad32c03f2a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a62630-4dfa-4de0-a474-7c7ebb474f5a),volume_type_id=14a62630-4dfa-4de0-a474-7c7ebb474f5a)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e315d0-d140-4846-801d-7c3a3b1bf323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e315d0-d140-4846-801d-7c3a3b1bf323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b991152-52b2-4a8b-ab11-a1c06c57ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b991152-52b2-4a8b-ab11-a1c06c57ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cccff9c-eb27-4301-bdd4-4387a4b8447f', 'volume_name': 'volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50308e0-7c25-4dca-a085-f09633a749f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50308e0-7c25-4dca-a085-f09633a749f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5331b0f5-748e-4303-8b51-2ff6d684173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:10 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Volume 2cccff9c-eb27-4301-bdd4-4387a4b8447f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f', 'volume_size': 1}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:10 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 1073741824" returned: 0 in 0.506s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:10 devstack sudo[87151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0
Feb 28 01:25:10 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:10 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0" returned: 0 in 0.411s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fc9090ea-44bf-4fe6-9090-0fc7c1f1ceaa,created_at=2026-02-28T00:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-525739089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fc9090ea-44bf-4fe6-9090-0fc7c1f1ceaa,host='devstack@QuobyteHD#QuobyteHD',id=2cccff9c-eb27-4301-bdd4-4387a4b8447f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10a3b33940c4c1dbbfe91b947a753de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:10Z,use_quota=True,user_id='5389b820a6eb4d80879fad32c03f2a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a62630-4dfa-4de0-a474-7c7ebb474f5a),volume_type_id=14a62630-4dfa-4de0-a474-7c7ebb474f5a)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Creating volume 2cccff9c-eb27-4301-bdd4-4387a4b8447f {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:10 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10364d53-5474-4b92-a5ee-ee90ac18f1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c5d434-7465-4c30-9d92-120d720ef3f0', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:10 devstack sudo[87154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f 1073741824
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec5c49f-ac4f-4e11-8d0f-e0fd2a739c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:10 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:10 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Volume volume-14c5d434-7465-4c30-9d92-120d720ef3f0 (14c5d434-7465-4c30-9d92-120d720ef3f0): created successfully
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec5c49f-ac4f-4e11-8d0f-e0fd2a739c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Flow 'volume_create_manager' (c4a4a7b8-83c2-4f3d-a731-068457b7672d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:10 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4f6d3295-2464-4999-a03b-1011fc505f77 tempest-VolumesSnapshotTestJSON-1782731118 None] Created volume successfully.
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Flow 'volume_create_manager' (8ea0b456-962a-4e23-900c-765e835a34bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47b6361-9a37-4484-9d05-50e0d90c791c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47b6361-9a37-4484-9d05-50e0d90c791c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1091941262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac43fa42-f789-4c93-b69d-c3d335a5fe43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafb5f9607314c34a120126e461945b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:11Z,use_quota=True,user_id='f256e3f8c9dd415fa1b02790b8e0a30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4150f9c2-7065-4deb-9ed9-79f7e7817970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4150f9c2-7065-4deb-9ed9-79f7e7817970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5613aade-0bd7-482c-8657-b135715f8cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5613aade-0bd7-482c-8657-b135715f8cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac43fa42-f789-4c93-b69d-c3d335a5fe43', 'volume_name': 'volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef74bb4b-b9c8-44d6-a4cf-309a8623f828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef74bb4b-b9c8-44d6-a4cf-309a8623f828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257ee8c3-ab24-4e09-9bfe-a573c968282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:11 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Volume ac43fa42-f789-4c93-b69d-c3d335a5fe43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43', 'volume_size': 1}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:11 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f 1073741824" returned: 0 in 0.634s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:11 devstack sudo[87159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f
Feb 28 01:25:11 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:11 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f" returned: 0 in 0.401s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1091941262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac43fa42-f789-4c93-b69d-c3d335a5fe43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafb5f9607314c34a120126e461945b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:11Z,use_quota=True,user_id='f256e3f8c9dd415fa1b02790b8e0a30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Creating volume ac43fa42-f789-4c93-b69d-c3d335a5fe43 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:11 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5331b0f5-748e-4303-8b51-2ff6d684173e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:11 devstack sudo[87163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43 1073741824
Feb 28 01:25:11 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bae02c-e9fc-43e0-a018-c01e6b39056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:11 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Volume volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f (2cccff9c-eb27-4301-bdd4-4387a4b8447f): created successfully
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bae02c-e9fc-43e0-a018-c01e6b39056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:11 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Flow 'volume_create_manager' (b9c00d25-e96f-4779-affb-9404b5809b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:11 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1123fafe-6fe8-4f6d-a06a-f1121be4ec95 tempest-GroupSnapshotsV319Test-1570285261 None] Created volume successfully.
Feb 28 01:25:12 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43 1073741824" returned: 0 in 0.504s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:12 devstack sudo[87168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43
Feb 28 01:25:12 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:12 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] GroupSnapshot a67dd6c4-de47-4493-a503-d98a60f836bf: creating.
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Group snapshot a67dd6c4-de47-4493-a503-d98a60f836bf: creating. {{(pid=82470) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:12 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43" returned: 0 in 0.409s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.474s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257ee8c3-ab24-4e09-9bfe-a573c968282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e470769-dd37-4c4c-8305-200ef34e5858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Creating offline snapshot 6f150486-8fde-41c8-bce9-156a99024951 of volume 14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:12 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Volume volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43 (ac43fa42-f789-4c93-b69d-c3d335a5fe43): created successfully
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e470769-dd37-4c4c-8305-200ef34e5858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Flow 'volume_create_manager' (8ea0b456-962a-4e23-900c-765e835a34bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc51931-2588-4f1e-bb95-2cc76c300f58]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:12 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-10b9ee9b-3379-417f-95c7-50a8e816ec2d tempest-VolumesTransfersTest-435800443 None] Created volume successfully.
Feb 28 01:25:12 devstack sudo[87171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0
Feb 28 01:25:12 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:13 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0" returned: 0 in 0.452s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:13 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 1G
Feb 28 01:25:13 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:13 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-49171781-68c0-47f4-b961-cc355318bccf tempest-VolumesTransfersTest-1585335197 None] Transfer volume completed successfully.
Feb 28 01:25:13 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 1G" returned: 0 in 0.526s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c5d434-7465-4c30-9d92-120d720ef3f0 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:13 devstack sudo[87181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c5d434-7465-4c30-9d92-120d720ef3f0 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951
Feb 28 01:25:13 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:14 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c5d434-7465-4c30-9d92-120d720ef3f0 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951" returned: 0 in 0.406s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:14 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 is being set with open permissions: ugo+rw
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:14 devstack sudo[87186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951
Feb 28 01:25:14 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Acquiring lock "cinder-ac43fa42-f789-4c93-b69d-c3d335a5fe43-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Lock "cinder-ac43fa42-f789-4c93-b69d-c3d335a5fe43-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Acquiring lock "cinder-quobyte-ac43fa42-f789-4c93-b69d-c3d335a5fe43" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Lock "cinder-quobyte-ac43fa42-f789-4c93-b69d-c3d335a5fe43" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd5c69b-0843-4636-82af-1e7153539a5b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:14 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951" returned: 0 in 0.413s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:14 devstack sudo[87189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43
Feb 28 01:25:14 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:14 devstack sudo[87190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.info
Feb 28 01:25:14 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:14 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43" returned: 0 in 0.453s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:14 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:14 devstack sudo[87197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43
Feb 28 01:25:14 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.info" returned: 0 in 0.413s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:14 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.info is being set with open permissions: ugo+rw
Feb 28 01:25:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:14 devstack sudo[87199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.info
Feb 28 01:25:14 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:15 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ac43fa42-f789-4c93-b69d-c3d335a5fe43" returned: 0 in 0.395s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Lock "cinder-quobyte-ac43fa42-f789-4c93-b69d-c3d335a5fe43" released by "delete_volume" :: held 0.880s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:15 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.info" returned: 0 in 0.395s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.678s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.036s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] Creating offline snapshot 0a9974b1-af81-430b-89d5-776e0e59ae6a of volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:15 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5310e772-702c-4f14-a5e4-08355fe6afdb tempest-VolumesSnapshotTestJSON-1782731118 None] Create snapshot completed successfully
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[39595844-b41e-499c-a5d1-53b2982de0b6]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Created reservations ['9f306eed-c382-47dd-9c7a-d568a707c7fc', 'edc368e6-13e0-4f9b-88ee-ecd0166edfec', '77900813-59da-4a6a-b3ec-5306f3012f4a', 'eb71be89-8dbd-45f1-9852-cb36dcf939d0'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:15 devstack sudo[87203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:15 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:15 devstack sudo[87204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:15 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Flow 'volume_create_manager' (e890e28b-fc2f-4f66-a81c-cc61e41f3adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c5abe0-2ae9-4053-a54d-0621516b7277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c5abe0-2ae9-4053-a54d-0621516b7277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1259777438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203ea7c8-5126-4115-b402-50975eb166b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafb5f9607314c34a120126e461945b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:16Z,use_quota=True,user_id='f256e3f8c9dd415fa1b02790b8e0a30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5357da-77e9-4a23-be4a-8626efef91fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5357da-77e9-4a23-be4a-8626efef91fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988cea5a-f2ef-4271-a5c0-beb8ed5c3a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988cea5a-f2ef-4271-a5c0-beb8ed5c3a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '203ea7c8-5126-4115-b402-50975eb166b8', 'volume_name': 'volume-203ea7c8-5126-4115-b402-50975eb166b8', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfe7f13-b911-4be3-a604-3ab747670fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfe7f13-b911-4be3-a604-3ab747670fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05469c45-9572-4529-b975-9687e3e44920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:15 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Volume 203ea7c8-5126-4115-b402-50975eb166b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-203ea7c8-5126-4115-b402-50975eb166b8', 'volume_size': 1}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:15 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.417s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:15 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Deleted volume successfully.
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bcdb88f0-3eaa-4e94-8cd0-54c4d0c419d5 tempest-VolumesTransfersTest-468390712 None] Lock "cinder-ac43fa42-f789-4c93-b69d-c3d335a5fe43-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:15 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.528s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:15 devstack sudo[87211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a 1G
Feb 28 01:25:15 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:16 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a 1G" returned: 0 in 0.529s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:16 devstack sudo[87216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a
Feb 28 01:25:16 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Flow 'volume_create_manager' (c36d6819-05eb-4ab5-adca-b49f7295950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17249cfb-9a5c-4594-b1d9-043779cbd2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17249cfb-9a5c-4594-b1d9-043779cbd2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1944981691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8dfe545-e955-4c65-975c-e3175b74d0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d089dfd720ee44809c26e4be447f95b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6f150486-8fde-41c8-bce9-156a99024951,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:17Z,use_quota=True,user_id='e8d945f70fdd46d1bb13c6a103bfda56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc3eb4a-a52c-4658-87f2-5c2469e6a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc3eb4a-a52c-4658-87f2-5c2469e6a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa1bfa3-6a80-4c83-a19e-6d1cc0561450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa1bfa3-6a80-4c83-a19e-6d1cc0561450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a8dfe545-e955-4c65-975c-e3175b74d0c4', 'volume_name': 'volume-a8dfe545-e955-4c65-975c-e3175b74d0c4', 'volume_size': 2, 'snapshot_id': '6f150486-8fde-41c8-bce9-156a99024951'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa382446-945e-4148-9d52-af739e773c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa382446-945e-4148-9d52-af739e773c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df3a555-2751-4857-9bd8-82912920668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:16 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Volume a8dfe545-e955-4c65-975c-e3175b74d0c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a8dfe545-e955-4c65-975c-e3175b74d0c4', 'volume_size': 2, 'snapshot_id': '6f150486-8fde-41c8-bce9-156a99024951'}
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:16 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a" returned: 0 in 0.442s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:16 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a is being set with open permissions: ugo+rw
Feb 28 01:25:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:16 devstack sudo[87221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a
Feb 28 01:25:16 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:17 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a" returned: 0 in 0.406s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.957s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Creating offline snapshot a77f533c-8fa1-441d-8b40-e104f17c65fa of volume 2cccff9c-eb27-4301-bdd4-4387a4b8447f {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5599f8-dca7-432f-b3bd-e3c50c88f095]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:17 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-14b9f266-34fe-43c9-a22e-6f4b64e3f5cb tempest-SnapshotsActionsTest-1171305829 None] Create snapshot completed successfully
Feb 28 01:25:17 devstack sudo[87263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f
Feb 28 01:25:17 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-0a9974b1-af81-430b-89d5-776e0e59ae6a-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-0a9974b1-af81-430b-89d5-776e0e59ae6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-quobyte-0a9974b1-af81-430b-89d5-776e0e59ae6a" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-0a9974b1-af81-430b-89d5-776e0e59ae6a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Deleting offline snapshot 0a9974b1-af81-430b-89d5-776e0e59ae6a of volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] snapshot_file for this snap is: volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bba2d0b-1d17-487a-ab0f-2a138a32bbb0]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:17 devstack sudo[87312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a
Feb 28 01:25:17 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:17 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f" returned: 0 in 0.533s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:17 devstack sudo[87317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa 1G
Feb 28 01:25:17 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:18 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a" returned: 0 in 0.492s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1be36cd-330c-4fde-8072-2585365b6a19]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:18 devstack sudo[87322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:18 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:18 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa 1G" returned: 0 in 0.446s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:18 devstack sudo[87327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa
Feb 28 01:25:18 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:18 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.489s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:18 devstack sudo[87332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a
Feb 28 01:25:18 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:18 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa" returned: 0 in 0.443s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:18 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:25:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:18 devstack sudo[87337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa
Feb 28 01:25:18 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:19 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a" returned: 0 in 0.473s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:19 devstack sudo[87342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a
Feb 28 01:25:19 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:19 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa" returned: 0 in 0.418s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:19 devstack sudo[87345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.info
Feb 28 01:25:19 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:19 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0a9974b1-af81-430b-89d5-776e0e59ae6a" returned: 0 in 0.399s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-0a9974b1-af81-430b-89d5-776e0e59ae6a" released by "_delete_snapshot" :: held 1.906s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" released by "delete_snapshot" :: held 1.916s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Created reservations ['6c131802-ee4b-4881-9e1d-0c8120257c30', '7410568a-79c6-48db-bb8c-bbb4e7ed1bc9', '163b5617-3d67-4dd5-a183-1cf9a5b698f7', '43f17715-f6b9-4973-b335-544f09dab74f'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:19 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Delete snapshot completed successfully.
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a9d3c12-4613-4e08-9e9e-67e98bcd768f tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-0a9974b1-af81-430b-89d5-776e0e59ae6a-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:19 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.info" returned: 0 in 0.407s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:19 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:19 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.info
Feb 28 01:25:19 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:20 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.info" returned: 0 in 0.417s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.721s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.226s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1259777438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203ea7c8-5126-4115-b402-50975eb166b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafb5f9607314c34a120126e461945b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:16Z,use_quota=True,user_id='f256e3f8c9dd415fa1b02790b8e0a30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Creating volume 203ea7c8-5126-4115-b402-50975eb166b8 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:20 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:20 devstack sudo[87352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8 1073741824
Feb 28 01:25:20 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-0a1f5fcf-49e2-4838-95c2-894864ab7a80 tempest-GroupSnapshotsV319Test-1570285261 None] group_snapshot a67dd6c4-de47-4493-a503-d98a60f836bf: created successfully
Feb 28 01:25:20 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8 1073741824" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:20 devstack sudo[87357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8
Feb 28 01:25:20 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] group_snapshot a67dd6c4-de47-4493-a503-d98a60f836bf: deleting
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] group_snapshot a67dd6c4-de47-4493-a503-d98a60f836bf: deleting {{(pid=82470) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Acquiring lock "cinder-quobyte-2cccff9c-eb27-4301-bdd4-4387a4b8447f" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Lock "cinder-quobyte-2cccff9c-eb27-4301-bdd4-4387a4b8447f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Acquiring lock "cinder-quobyte-a77f533c-8fa1-441d-8b40-e104f17c65fa" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Lock "cinder-quobyte-a77f533c-8fa1-441d-8b40-e104f17c65fa" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Deleting offline snapshot a77f533c-8fa1-441d-8b40-e104f17c65fa of volume 2cccff9c-eb27-4301-bdd4-4387a4b8447f {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] snapshot_file for this snap is: volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc66ee-aa00-4b02-9f45-1ab76de2845d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:21 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8" returned: 0 in 0.462s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:21 devstack sudo[87360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa
Feb 28 01:25:21 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.297s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-6f150486-8fde-41c8-bce9-156a99024951-a8dfe545-e955-4c65-975c-e3175b74d0c4" by "_create_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05469c45-9572-4529-b975-9687e3e44920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203ea7c8-5126-4115-b402-50975eb166b8', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e518ce7b-8980-4615-8fdc-1405f06e595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:21 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Volume volume-203ea7c8-5126-4115-b402-50975eb166b8 (203ea7c8-5126-4115-b402-50975eb166b8): created successfully
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e518ce7b-8980-4615-8fdc-1405f06e595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Flow 'volume_create_manager' (e890e28b-fc2f-4f66-a81c-cc61e41f3adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-6f150486-8fde-41c8-bce9-156a99024951-a8dfe545-e955-4c65-975c-e3175b74d0c4" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Creating volume a8dfe545-e955-4c65-975c-e3175b74d0c4 from snapshot 6f150486-8fde-41c8-bce9-156a99024951 {{(pid=82470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-a8dfe545-e955-4c65-975c-e3175b74d0c4" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:21 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1d7b8b24-74ec-4268-9254-f08fa969ce32 tempest-VolumesTransfersTest-435800443 None] Created volume successfully.
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-a8dfe545-e955-4c65-975c-e3175b74d0c4" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] snapshot: 6f150486-8fde-41c8-bce9-156a99024951, volume: a8dfe545-e955-4c65-975c-e3175b74d0c4,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f80a7a7-dc1a-4bf4-b4a5-377e65708bb7]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:21 devstack sudo[87362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951
Feb 28 01:25:21 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:21 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa" returned: 0 in 0.475s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4103e99-fccf-47cc-b33a-b83731df0b15]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:21 devstack sudo[87367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f
Feb 28 01:25:21 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:21 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951" returned: 0 in 0.471s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14c5d434-7465-4c30-9d92-120d720ef3f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[71253288-317f-41cc-855b-5026d88cf784]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:21 devstack sudo[87372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0
Feb 28 01:25:21 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:21 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f" returned: 0 in 0.492s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:21 devstack sudo[87378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa
Feb 28 01:25:21 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:22 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0" returned: 0 in 0.504s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4 not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:22 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4
Feb 28 01:25:22 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Acquiring lock "cinder-203ea7c8-5126-4115-b402-50975eb166b8-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Lock "cinder-203ea7c8-5126-4115-b402-50975eb166b8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Acquiring lock "cinder-quobyte-203ea7c8-5126-4115-b402-50975eb166b8" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Lock "cinder-quobyte-203ea7c8-5126-4115-b402-50975eb166b8" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e9e9e3-28e9-4694-8034-526b1f9eea40]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:22 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8
Feb 28 01:25:22 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:22 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa" returned: 0 in 0.529s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:22 devstack sudo[87390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa
Feb 28 01:25:22 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:23 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8" returned: 0 in 0.855s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:23 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8
Feb 28 01:25:23 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:23 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f.a77f533c-8fa1-441d-8b40-e104f17c65fa" returned: 0 in 0.969s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:23 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Lock "cinder-quobyte-a77f533c-8fa1-441d-8b40-e104f17c65fa" released by "_delete_snapshot" :: held 2.542s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:23 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Lock "cinder-quobyte-2cccff9c-eb27-4301-bdd4-4387a4b8447f" released by "delete_snapshot" :: held 2.566s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:23 devstack cinder-volume[82470]: WARNING cinder.quota [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-704138471 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-704138471, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:25:23 devstack cinder-volume[82470]: WARNING cinder.quota [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-704138471 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-704138471, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:25:23 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] Created reservations ['0af4c8dd-78f4-4182-9625-64703c169765', 'bc8bbec2-fe88-4495-85f9-7dc8e2ba403c', '78459dba-05d3-44db-a89c-761527cc6ec6', 'dc3fb0a8-01ee-4052-ad38-399fb28548c5'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:23 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2f8d5bc5-dea7-42de-b2a4-5b123db7f613 tempest-GroupSnapshotsV319Test-1570285261 None] group_snapshot a67dd6c4-de47-4493-a503-d98a60f836bf: deleted successfully
Feb 28 01:25:24 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4" returned: 0 in 2.249s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[049f6be7-fd31-4b22-88af-5a54c4b79ac4]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:24 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-203ea7c8-5126-4115-b402-50975eb166b8" returned: 0 in 1.187s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Lock "cinder-quobyte-203ea7c8-5126-4115-b402-50975eb166b8" released by "delete_volume" :: held 2.075s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Acquiring lock "cinder-quobyte-2cccff9c-eb27-4301-bdd4-4387a4b8447f" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Lock "cinder-quobyte-2cccff9c-eb27-4301-bdd4-4387a4b8447f" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[998cd0d4-92a9-4aa9-bc72-70686954aae5]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:24 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0
Feb 28 01:25:24 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Created reservations ['7a6ac595-3ee5-494e-a548-749f6a4b5efb', '324e7fac-49b9-4396-9de3-0a08214c7aad', 'c190d70f-dfc6-42c6-94ab-efb66e55515d', 'd18bda1b-6ae0-47fe-9d8a-e72a859579f6'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:24 devstack sudo[87411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f
Feb 28 01:25:24 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:24 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:24 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:24 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.394s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:24 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Deleted volume successfully.
Feb 28 01:25:24 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e7afc94-f1ad-4d26-810c-2c40f0f9373e tempest-VolumesTransfersTest-468390712 None] Lock "cinder-203ea7c8-5126-4115-b402-50975eb166b8-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f" returned: 0 in 0.486s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:24 devstack sudo[87422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f
Feb 28 01:25:24 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:25 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0" returned: 0 in 0.661s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:25:25 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Converted 1024.00 MB image at 455.19 MB/s
Feb 28 01:25:25 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4 is being set with open permissions: ugo+rw
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:25 devstack sudo[87424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4
Feb 28 01:25:25 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:25 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cccff9c-eb27-4301-bdd4-4387a4b8447f" returned: 0 in 0.403s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Lock "cinder-quobyte-2cccff9c-eb27-4301-bdd4-4387a4b8447f" released by "delete_volume" :: held 0.933s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Created reservations ['d03e2422-e07f-442a-bc9a-e4ae22fb312e'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:25 devstack cinder-volume[82470]: WARNING cinder.quota [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-704138471 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-704138471, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Created reservations ['09333155-48e6-455f-bdbe-1590131a1f6d', 'fb6887c8-da82-4f28-ab63-1e2c7ce2ba17', 'a15fa8f0-79f9-4184-8c5a-87d35d34eb8e', '3bd05a36-1cff-458b-82a6-e6c190032af1'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:25 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4" returned: 0 in 0.419s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-a8dfe545-e955-4c65-975c-e3175b74d0c4" released by "_copy_volume_from_snapshot" :: held 4.356s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-6f150486-8fde-41c8-bce9-156a99024951-a8dfe545-e955-4c65-975c-e3175b74d0c4" released by "_create_volume_from_snapshot" :: held 4.376s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.410s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.564s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df3a555-2751-4857-9bd8-82912920668c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8dfe545-e955-4c65-975c-e3175b74d0c4', 'volume_size': 2, 'snapshot_id': '6f150486-8fde-41c8-bce9-156a99024951'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8eec274-5b3c-402a-ace2-bbd315ad5372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] Creating offline snapshot e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e of volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:25 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Volume volume-a8dfe545-e955-4c65-975c-e3175b74d0c4 (a8dfe545-e955-4c65-975c-e3175b74d0c4): created successfully
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8eec274-5b3c-402a-ace2-bbd315ad5372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Flow 'volume_create_manager' (c36d6819-05eb-4ab5-adca-b49f7295950c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7103d379-23c4-44ec-9fc3-f1bc55a171b3]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:25 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7739fa68-19ca-4658-a3ac-26bdb83592ed tempest-VolumesSnapshotTestJSON-1782731118 None] Created volume successfully.
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:25 devstack sudo[87429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:25 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:25 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:25 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:26 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.428s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3b9bd70f-74e5-4afb-a5c7-ff3541c8778d tempest-GroupSnapshotsV319Test-1570285261 None] Delete group completed successfully.
Feb 28 01:25:26 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.516s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:26 devstack sudo[87436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e 1G
Feb 28 01:25:26 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-a8dfe545-e955-4c65-975c-e3175b74d0c4-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-a8dfe545-e955-4c65-975c-e3175b74d0c4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-a8dfe545-e955-4c65-975c-e3175b74d0c4" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-a8dfe545-e955-4c65-975c-e3175b74d0c4" acquired by "delete_volume" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b6890a-976d-496d-b22b-3e46099c1ae7]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:26 devstack sudo[87441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4
Feb 28 01:25:26 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:26 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e 1G" returned: 0 in 0.526s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:26 devstack sudo[87443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e
Feb 28 01:25:26 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:27 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4" returned: 0 in 0.689s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:27 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4
Feb 28 01:25:27 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:27 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e" returned: 0 in 0.586s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:27 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e is being set with open permissions: ugo+rw
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:27 devstack sudo[87453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e
Feb 28 01:25:27 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:27 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e" returned: 0 in 0.475s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:27 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-6cadd402-8f4d-4383-bcb8-12eccada2b02 tempest-SnapshotsActionsTest-1171305829 None] Create snapshot completed successfully
Feb 28 01:25:27 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8dfe545-e955-4c65-975c-e3175b74d0c4" returned: 0 in 0.599s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-a8dfe545-e955-4c65-975c-e3175b74d0c4" released by "delete_volume" :: held 1.326s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Created reservations ['0399e2ce-c291-40e3-9ea9-f0ad956631ee', 'df459ac9-72b6-4f4b-a584-64744d0dc4c7', '7acbc5d3-a4b5-431a-b8e8-8e6f1b7c307f', '663de47e-6bc8-4f42-a467-9256e284b908'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:27 devstack sudo[87457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:27 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:28 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.489s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:28 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Deleted volume successfully.
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d264e7a-713e-4358-be9f-8b330c9c300a tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-a8dfe545-e955-4c65-975c-e3175b74d0c4-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-quobyte-e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Deleting offline snapshot e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e of volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] snapshot_file for this snap is: volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d47d686-559f-4c45-9620-2328cbaeb021]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:28 devstack sudo[87460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e
Feb 28 01:25:28 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-6f150486-8fde-41c8-bce9-156a99024951-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-6f150486-8fde-41c8-bce9-156a99024951-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-14c5d434-7465-4c30-9d92-120d720ef3f0" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-14c5d434-7465-4c30-9d92-120d720ef3f0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-6f150486-8fde-41c8-bce9-156a99024951" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-6f150486-8fde-41c8-bce9-156a99024951" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Deleting offline snapshot 6f150486-8fde-41c8-bce9-156a99024951 of volume 14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] snapshot_file for this snap is: volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ed7811-eb2a-4881-906b-78d34ccbad73]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:28 devstack sudo[87462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951
Feb 28 01:25:28 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:29 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e" returned: 0 in 0.693s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[66489a56-c41f-4e09-8e1c-4b5b69ac33fe]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:29 devstack sudo[87468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:29 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:29 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951" returned: 0 in 0.576s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14c5d434-7465-4c30-9d92-120d720ef3f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[805c998e-1e5f-41d7-8a4b-a59b5c307d9d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:29 devstack sudo[87473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0
Feb 28 01:25:29 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Flow 'volume_create_manager' (b59d2ea1-adb3-4ce6-88c4-040521a1e794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e512b5dc-063b-4767-baf6-09b5631c9f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e512b5dc-063b-4767-baf6-09b5631c9f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-234344748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec155534-49cb-4afd-a7e2-50fb0961f3ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='893bcce11b2b4e219368ec98c1a02601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:30Z,use_quota=True,user_id='074996f6646341b48f5afa49c89bc0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2879fbd8-3e32-4f78-9cbe-2f1dab33b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2879fbd8-3e32-4f78-9cbe-2f1dab33b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae28df89-8084-4dd0-8617-f1c2837a2ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae28df89-8084-4dd0-8617-f1c2837a2ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec155534-49cb-4afd-a7e2-50fb0961f3ba', 'volume_name': 'volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59a8e48-d2e1-4b42-bbd5-33338d0bd45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59a8e48-d2e1-4b42-bbd5-33338d0bd45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed7ea21-e3c1-4711-9bf7-aaeea39ebd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:29 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Volume ec155534-49cb-4afd-a7e2-50fb0961f3ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba', 'volume_size': 1}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-234344748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec155534-49cb-4afd-a7e2-50fb0961f3ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='893bcce11b2b4e219368ec98c1a02601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:30Z,use_quota=True,user_id='074996f6646341b48f5afa49c89bc0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Creating volume ec155534-49cb-4afd-a7e2-50fb0961f3ba {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:29 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:29 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.631s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:29 devstack sudo[87478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba 1073741824
Feb 28 01:25:29 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:29 devstack sudo[87479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e
Feb 28 01:25:29 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:29 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0" returned: 0 in 0.648s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:29 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951
Feb 28 01:25:29 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:30 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba 1073741824" returned: 0 in 0.600s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:30 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e" returned: 0 in 0.619s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:30 devstack sudo[87493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba
Feb 28 01:25:30 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:30 devstack sudo[87494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e
Feb 28 01:25:30 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:30 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951" returned: 0 in 0.603s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:30 devstack sudo[87500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951
Feb 28 01:25:30 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:30 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e" returned: 0 in 0.511s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:30 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba" returned: 0 in 0.540s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e" released by "_delete_snapshot" :: held 2.524s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed7ea21-e3c1-4711-9bf7-aaeea39ebd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa820600-89ec-46e8-8f7b-89831b498ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" released by "delete_snapshot" :: held 2.550s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:30 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Volume volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba (ec155534-49cb-4afd-a7e2-50fb0961f3ba): created successfully
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa820600-89ec-46e8-8f7b-89831b498ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Flow 'volume_create_manager' (b59d2ea1-adb3-4ce6-88c4-040521a1e794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:30 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-30295961-b22d-4733-b510-5a1c9b229d39 tempest-VolumesListTestJSON-1545212779 None] Created volume successfully.
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Created reservations ['c6d6d66b-babb-40e2-a606-1d379459420e', 'e4f45d6f-03fb-4340-9f6c-99f7afb4491a', 'd919f51f-e991-4d51-9292-c1a004d2e333', '55f389fe-6c21-4852-9ee4-6207b0ddf0c9'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:30 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Delete snapshot completed successfully.
Feb 28 01:25:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-93eb7ea3-aa0e-404a-8e52-980d29d00594 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-e72dd21b-c1de-4cbc-bdf7-ef99e46fe51e-delete_snapshot" released by "delete_snapshot" :: held 2.644s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:31 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0.6f150486-8fde-41c8-bce9-156a99024951" returned: 0 in 0.575s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-6f150486-8fde-41c8-bce9-156a99024951" released by "_delete_snapshot" :: held 2.455s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-14c5d434-7465-4c30-9d92-120d720ef3f0" released by "delete_snapshot" :: held 2.474s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Created reservations ['0f02c01f-3fd9-44d9-b762-3b88ede2abc8', 'f0b3847a-1907-4ab0-84ab-70ee3fc9f71f', '2d7e12bb-1518-4674-a048-a727125975ad', '60d91dc8-b8f9-45fe-9c50-b5071dc91054'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:31 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Delete snapshot completed successfully.
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5e5f2caf-7e2f-4202-a48f-2698a62e410b tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-6f150486-8fde-41c8-bce9-156a99024951-delete_snapshot" released by "delete_snapshot" :: held 2.552s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] Creating offline snapshot d27f377f-d070-4ac6-9dbe-205d2854f9c0 of volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e3c222-738c-4e05-b7f5-b6bd154fd679]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-14c5d434-7465-4c30-9d92-120d720ef3f0-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-14c5d434-7465-4c30-9d92-120d720ef3f0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:31 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:31 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-14c5d434-7465-4c30-9d92-120d720ef3f0" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-14c5d434-7465-4c30-9d92-120d720ef3f0" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eddc7c8-9ba4-41eb-bd54-2edd7dcf6f15]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:32 devstack sudo[87508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0
Feb 28 01:25:32 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Flow 'volume_create_manager' (1aa2a9ee-1254-4294-8937-c789f3e909d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b25c780-575a-48cf-9aa8-810059e6b3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b25c780-575a-48cf-9aa8-810059e6b3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2082109479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8486912f-2723-4903-b891-59c6b94c289e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='893bcce11b2b4e219368ec98c1a02601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:32Z,use_quota=True,user_id='074996f6646341b48f5afa49c89bc0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87636ba-e115-4f22-aab6-ee746e92b5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87636ba-e115-4f22-aab6-ee746e92b5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486a420e-8674-47c3-a3dd-214c717fce5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486a420e-8674-47c3-a3dd-214c717fce5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8486912f-2723-4903-b891-59c6b94c289e', 'volume_name': 'volume-8486912f-2723-4903-b891-59c6b94c289e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266bff6b-793b-4349-a51a-051a6c3ac64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266bff6b-793b-4349-a51a-051a6c3ac64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f708acf3-1b33-412e-b6ea-e77eeeb637c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:32 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Volume 8486912f-2723-4903-b891-59c6b94c289e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8486912f-2723-4903-b891-59c6b94c289e', 'volume_size': 1}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:32 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.568s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:32 devstack sudo[87513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0 1G
Feb 28 01:25:32 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:32 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0" returned: 0 in 0.560s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:32 devstack sudo[87518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0
Feb 28 01:25:32 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:32 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0 1G" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:32 devstack sudo[87523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0
Feb 28 01:25:32 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:32 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14c5d434-7465-4c30-9d92-120d720ef3f0" returned: 0 in 0.412s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-14c5d434-7465-4c30-9d92-120d720ef3f0" released by "delete_volume" :: held 1.023s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Created reservations ['d195f16e-1481-4105-afdb-5b9d12b7be90', '6c50a590-ffd8-4ba2-bff0-8ca95d770618', 'cd3add07-b446-4757-9dff-3782bbdd7df1', '419027a3-3c87-444c-98fd-97827a04314c'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:33 devstack sudo[87526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:33 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:33 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Flow 'volume_create_manager' (2de2b772-4320-4c9c-884c-bce52af55924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e14c3e-fe00-4749-aa35-94c0032a763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0" returned: 0 in 0.487s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:33 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0 is being set with open permissions: ugo+rw
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:33 devstack sudo[87531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0
Feb 28 01:25:33 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e14c3e-fe00-4749-aa35-94c0032a763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1970883171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a15586d-1cdd-46b8-b260-d484324ce157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f704bc032274ac5b608149588b8c171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:33Z,use_quota=True,user_id='7354ef73f0df4964821a3d5ff5db3b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99c8e6e3-8649-45f7-9be0-18c583f1c299),volume_type_id=99c8e6e3-8649-45f7-9be0-18c583f1c299)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acab251-fd91-4f79-bf74-facc20038b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acab251-fd91-4f79-bf74-facc20038b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b939be8-249f-4a3b-a259-b2ecddd05bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b939be8-249f-4a3b-a259-b2ecddd05bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a15586d-1cdd-46b8-b260-d484324ce157', 'volume_name': 'volume-1a15586d-1cdd-46b8-b260-d484324ce157', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10105f7b-c594-4d7e-8cb3-d03c46c80966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10105f7b-c594-4d7e-8cb3-d03c46c80966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698a952a-ca12-4124-be31-1022c2248d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:33 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Volume 1a15586d-1cdd-46b8-b260-d484324ce157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a15586d-1cdd-46b8-b260-d484324ce157', 'volume_size': 1}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:33 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.437s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:33 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Deleted volume successfully.
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ee673476-2f2c-4c51-86c0-c280f9ce624c tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-14c5d434-7465-4c30-9d92-120d720ef3f0-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:33 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0" returned: 0 in 0.397s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.543s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2082109479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8486912f-2723-4903-b891-59c6b94c289e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='893bcce11b2b4e219368ec98c1a02601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:32Z,use_quota=True,user_id='074996f6646341b48f5afa49c89bc0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Creating volume 8486912f-2723-4903-b891-59c6b94c289e {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:33 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:33 devstack sudo[87535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e 1073741824
Feb 28 01:25:33 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:33 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8525e0e6-a565-4e49-b86b-df48e89e017a tempest-SnapshotsActionsTest-1171305829 None] Create snapshot completed successfully
Feb 28 01:25:34 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e 1073741824" returned: 0 in 0.498s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:34 devstack sudo[87540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e
Feb 28 01:25:34 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Flow 'volume_create_manager' (8f7ed53b-f3ac-43a2-b945-9a5837ffc01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c7bd1f-4230-4954-a25e-a6df21164141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c7bd1f-4230-4954-a25e-a6df21164141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1166893332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ece0fd-c6f7-4c9a-844d-b58c29d1abad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d089dfd720ee44809c26e4be447f95b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:34Z,use_quota=True,user_id='e8d945f70fdd46d1bb13c6a103bfda56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052ac73a-1ad8-4015-bf8b-7e195d8e2c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052ac73a-1ad8-4015-bf8b-7e195d8e2c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c56ba4a-faac-43cf-9c4a-f7098cc54021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c56ba4a-faac-43cf-9c4a-f7098cc54021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ece0fd-c6f7-4c9a-844d-b58c29d1abad', 'volume_name': 'volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f590e578-c45b-4a2c-858c-4a757d79442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f590e578-c45b-4a2c-858c-4a757d79442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fe2256-1ad9-40ac-af12-22b7130915b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:34 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Volume 28ece0fd-c6f7-4c9a-844d-b58c29d1abad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad', 'volume_size': 1}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:34 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e" returned: 0 in 0.395s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.292s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1970883171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a15586d-1cdd-46b8-b260-d484324ce157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f704bc032274ac5b608149588b8c171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:33Z,use_quota=True,user_id='7354ef73f0df4964821a3d5ff5db3b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99c8e6e3-8649-45f7-9be0-18c583f1c299),volume_type_id=99c8e6e3-8649-45f7-9be0-18c583f1c299)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Creating volume 1a15586d-1cdd-46b8-b260-d484324ce157 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:34 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f708acf3-1b33-412e-b6ea-e77eeeb637c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8486912f-2723-4903-b891-59c6b94c289e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:34 devstack sudo[87543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157 1073741824
Feb 28 01:25:34 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd8ff65-3e24-4ca4-8a32-82764b9dda95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:34 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Volume volume-8486912f-2723-4903-b891-59c6b94c289e (8486912f-2723-4903-b891-59c6b94c289e): created successfully
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd8ff65-3e24-4ca4-8a32-82764b9dda95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Flow 'volume_create_manager' (1aa2a9ee-1254-4294-8937-c789f3e909d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:34 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-6f57b6e5-b400-44a3-8fe7-c50ceef4b880 tempest-VolumesListTestJSON-1545212779 None] Created volume successfully.
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-d27f377f-d070-4ac6-9dbe-205d2854f9c0-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-d27f377f-d070-4ac6-9dbe-205d2854f9c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-quobyte-d27f377f-d070-4ac6-9dbe-205d2854f9c0" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-d27f377f-d070-4ac6-9dbe-205d2854f9c0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Deleting offline snapshot d27f377f-d070-4ac6-9dbe-205d2854f9c0 of volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] snapshot_file for this snap is: volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[384d1a20-2391-4a95-9769-bd99c80b9b57]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:35 devstack sudo[87545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0
Feb 28 01:25:35 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:35 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157 1073741824" returned: 0 in 0.468s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:35 devstack sudo[87550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157
Feb 28 01:25:35 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:35 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0" returned: 0 in 0.531s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ae4f90-9256-45df-a177-3071d58b66e2]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:35 devstack sudo[87555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:35 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:35 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Flow 'volume_create_manager' (6f132397-55d2-4adc-a5b6-de2b8196cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7cb33f-3c23-4900-9095-c2cc8e10818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157" returned: 0 in 0.458s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.259s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1166893332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ece0fd-c6f7-4c9a-844d-b58c29d1abad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d089dfd720ee44809c26e4be447f95b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:34Z,use_quota=True,user_id='e8d945f70fdd46d1bb13c6a103bfda56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Creating volume 28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:35 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698a952a-ca12-4124-be31-1022c2248d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a15586d-1cdd-46b8-b260-d484324ce157', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693a8e5b-9b12-4194-81cc-d5bd87fd2f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:35 devstack sudo[87558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad 1073741824
Feb 28 01:25:35 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7cb33f-3c23-4900-9095-c2cc8e10818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1141070936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8917ef6-1e52-4ca3-b559-615cc1e1e511,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='893bcce11b2b4e219368ec98c1a02601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:36Z,use_quota=True,user_id='074996f6646341b48f5afa49c89bc0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f191ea34-6515-43f6-a5f4-4ef4d412de09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f191ea34-6515-43f6-a5f4-4ef4d412de09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf3e427-46b0-416b-95ed-63d46007689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf3e427-46b0-416b-95ed-63d46007689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8917ef6-1e52-4ca3-b559-615cc1e1e511', 'volume_name': 'volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb5e786-c9c3-4c6c-963a-b4e7962a78fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb5e786-c9c3-4c6c-963a-b4e7962a78fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13919568-0370-4143-a178-7773884bea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:35 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Volume f8917ef6-1e52-4ca3-b559-615cc1e1e511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511', 'volume_size': 1}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:35 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Volume volume-1a15586d-1cdd-46b8-b260-d484324ce157 (1a15586d-1cdd-46b8-b260-d484324ce157): created successfully
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693a8e5b-9b12-4194-81cc-d5bd87fd2f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Flow 'volume_create_manager' (2de2b772-4320-4c9c-884c-bce52af55924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:35 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4bedb24f-e235-4b69-8996-dba348b4be2b tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Created volume successfully.
Feb 28 01:25:36 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.542s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:36 devstack sudo[87566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0
Feb 28 01:25:36 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:36 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad 1073741824" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:36 devstack sudo[87568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad
Feb 28 01:25:36 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:36 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0" returned: 0 in 0.473s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:36 devstack sudo[87574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0
Feb 28 01:25:36 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:36 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" returned: 0 in 0.403s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1141070936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8917ef6-1e52-4ca3-b559-615cc1e1e511,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='893bcce11b2b4e219368ec98c1a02601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:36Z,use_quota=True,user_id='074996f6646341b48f5afa49c89bc0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Creating volume f8917ef6-1e52-4ca3-b559-615cc1e1e511 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:36 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:36 devstack sudo[87576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511 1073741824
Feb 28 01:25:36 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fe2256-1ad9-40ac-af12-22b7130915b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043c7904-1312-4eac-9390-facadcdc2ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:36 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Volume volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad (28ece0fd-c6f7-4c9a-844d-b58c29d1abad): created successfully
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043c7904-1312-4eac-9390-facadcdc2ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Flow 'volume_create_manager' (8f7ed53b-f3ac-43a2-b945-9a5837ffc01e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:36 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-99ed2e3d-da2b-4cf5-9e79-8a502fe7c707 tempest-VolumesSnapshotTestJSON-1782731118 None] Created volume successfully.
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:UPDATE=250,cinder:SELECT=226,cinder:INSERT=63,cinder:DELETE=12 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96ac89d9-fc0a-47c6-bea0-7fa64b613192 tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96ac89d9-fc0a-47c6-bea0-7fa64b613192 tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96ac89d9-fc0a-47c6-bea0-7fa64b613192 tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96ac89d9-fc0a-47c6-bea0-7fa64b613192 tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96ac89d9-fc0a-47c6-bea0-7fa64b613192 tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96ac89d9-fc0a-47c6-bea0-7fa64b613192 tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:36 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:36 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:36 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.d27f377f-d070-4ac6-9dbe-205d2854f9c0" returned: 0 in 0.435s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-d27f377f-d070-4ac6-9dbe-205d2854f9c0" released by "_delete_snapshot" :: held 2.026s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" released by "delete_snapshot" :: held 2.037s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:36 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Created reservations ['a3069d40-a430-4208-83f4-54808ddc2d92', 'c06f8647-5456-493c-902a-be222621e0e6', '6e998231-150c-4fc5-ba0c-fd0193b59abb', '8c2ecd26-d7ab-44ef-85d3-8a796a44d332'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:37 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Delete snapshot completed successfully.
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cabf7de5-c1ca-4561-a5aa-a29a3d77ad05 tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-d27f377f-d070-4ac6-9dbe-205d2854f9c0-delete_snapshot" released by "delete_snapshot" :: held 2.124s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:37 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511 1073741824" returned: 0 in 0.536s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:37 devstack sudo[87584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511
Feb 28 01:25:37 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:37 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96ac89d9-fc0a-47c6-bea0-7fa64b613192 tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.449s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-96ac89d9-fc0a-47c6-bea0-7fa64b613192 tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:37 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-96ac89d9-fc0a-47c6-bea0-7fa64b613192 tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Retype volume completed successfully.
Feb 28 01:25:37 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511" returned: 0 in 0.427s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13919568-0370-4143-a178-7773884bea40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64ec3f7-1eb2-4d45-b1c0-85f29207b76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:37 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Volume volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511 (f8917ef6-1e52-4ca3-b559-615cc1e1e511): created successfully
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64ec3f7-1eb2-4d45-b1c0-85f29207b76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Flow 'volume_create_manager' (6f132397-55d2-4adc-a5b6-de2b8196cda0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:37 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2eff5ae3-ea13-4ad5-b13f-38cb2007a4a6 tempest-VolumesListTestJSON-1545212779 None] Created volume successfully.
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Creating offline snapshot a5ee638d-a9bd-401e-81a3-3d5533162884 of volume 28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d17ccc2-c21c-4783-a3f7-2b620039b44b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:37 devstack sudo[87588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad
Feb 28 01:25:37 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Acquiring lock "cinder-1a15586d-1cdd-46b8-b260-d484324ce157-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "cinder-1a15586d-1cdd-46b8-b260-d484324ce157-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Acquiring lock "cinder-quobyte-1a15586d-1cdd-46b8-b260-d484324ce157" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "cinder-quobyte-1a15586d-1cdd-46b8-b260-d484324ce157" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba533e1-a05b-47cc-a228-2a25be5bed74]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:38 devstack sudo[87590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157
Feb 28 01:25:38 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:38 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" returned: 0 in 0.550s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:38 devstack sudo[87595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 1G
Feb 28 01:25:38 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:38 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157" returned: 0 in 0.565s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:38 devstack sudo[87603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157
Feb 28 01:25:38 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:38 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 1G" returned: 0 in 0.519s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:38 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884
Feb 28 01:25:38 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:39 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1a15586d-1cdd-46b8-b260-d484324ce157" returned: 0 in 0.449s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "cinder-quobyte-1a15586d-1cdd-46b8-b260-d484324ce157" released by "delete_volume" :: held 1.040s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:39 devstack cinder-volume[82470]: WARNING cinder.quota [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:25:39 devstack cinder-volume[82470]: WARNING cinder.quota [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Created reservations ['cb3fe94a-4c25-43ec-8714-d27eda131336', 'eaff22d5-eabd-4131-9ef5-e4038b29a31f', 'e16f5512-fcf8-4dfc-b9a5-8f10632c3720', '581bac93-f9ea-409a-8c6a-667401ceabbf'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:39 devstack sudo[87645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:39 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:39 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884" returned: 0 in 0.477s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:39 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 is being set with open permissions: ugo+rw
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:39 devstack sudo[87647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884
Feb 28 01:25:39 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:39 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.411s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:39 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Deleted volume successfully.
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-53c71dbd-7c5a-4081-bcbb-d80254fc26aa tempest-VolumeRetypeWithoutMigrationTest-1434795144 None] Lock "cinder-1a15586d-1cdd-46b8-b260-d484324ce157-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:39 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884" returned: 0 in 0.480s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:39 devstack sudo[87651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.info
Feb 28 01:25:39 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "cinder-f8917ef6-1e52-4ca3-b559-615cc1e1e511-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-f8917ef6-1e52-4ca3-b559-615cc1e1e511-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "cinder-quobyte-f8917ef6-1e52-4ca3-b559-615cc1e1e511" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-quobyte-f8917ef6-1e52-4ca3-b559-615cc1e1e511" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5cfe16-d23d-41fe-bab5-39ad1d82933e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:40 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.info" returned: 0 in 0.423s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:40 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.info is being set with open permissions: ugo+rw
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:40 devstack sudo[87661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.info
Feb 28 01:25:40 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:40 devstack sudo[87660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511
Feb 28 01:25:40 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:40 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.info" returned: 0 in 0.437s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.297s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] Creating offline snapshot e81a571b-5bb6-47a5-8c9b-a0096a613683 of volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfdeba6-dbb6-4ca9-b45c-c4f1ee46987d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:40 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ce20d1e5-0858-4f74-bc3e-3989db4ef44e tempest-VolumesSnapshotTestJSON-1782731118 None] Create snapshot completed successfully
Feb 28 01:25:40 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511" returned: 0 in 0.567s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:40 devstack sudo[87669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511
Feb 28 01:25:40 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:40 devstack sudo[87668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:40 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:41 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Flow 'volume_create_manager' (f0fd2dc0-7474-4ae4-9484-165d9aead3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5e7eb6-fd29-4f18-ae22-3950ad7dfa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:41 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5e7eb6-fd29-4f18-ae22-3950ad7dfa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545189034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c6621c-cb31-451c-8e6c-3b31fb65e762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d089dfd720ee44809c26e4be447f95b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a5ee638d-a9bd-401e-81a3-3d5533162884,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:41Z,use_quota=True,user_id='e8d945f70fdd46d1bb13c6a103bfda56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a170ce5b-bde5-41b1-87a4-5d3a8224492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a170ce5b-bde5-41b1-87a4-5d3a8224492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8b6c4f-bff3-4f4f-8ce0-6d76a757c59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8b6c4f-bff3-4f4f-8ce0-6d76a757c59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '19c6621c-cb31-451c-8e6c-3b31fb65e762', 'volume_name': 'volume-19c6621c-cb31-451c-8e6c-3b31fb65e762', 'volume_size': 1, 'snapshot_id': 'a5ee638d-a9bd-401e-81a3-3d5533162884'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c7655f-34c1-42b3-a056-e201f720f329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c7655f-34c1-42b3-a056-e201f720f329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7a774f-11ff-43c3-9a35-7c43776479a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:41 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Volume 19c6621c-cb31-451c-8e6c-3b31fb65e762: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-19c6621c-cb31-451c-8e6c-3b31fb65e762', 'volume_size': 1, 'snapshot_id': 'a5ee638d-a9bd-401e-81a3-3d5533162884'}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f8917ef6-1e52-4ca3-b559-615cc1e1e511" returned: 0 in 0.570s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.628s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-quobyte-f8917ef6-1e52-4ca3-b559-615cc1e1e511" released by "delete_volume" :: held 1.167s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:41 devstack sudo[87677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683 1G
Feb 28 01:25:41 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Created reservations ['acbdc8e0-1928-40f3-ae13-567fd27f8a8c', '52a2f0d5-3baf-40ea-a118-ae6d8d6c047c', '516a1428-357c-4e00-96d1-033dc6b2134e', 'baac0a29-1779-4139-8e26-7ce59e5a2839'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:41 devstack sudo[87679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:41 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:41 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:41 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683 1G" returned: 0 in 0.506s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.421s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:41 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Deleted volume successfully.
Feb 28 01:25:41 devstack sudo[87685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683
Feb 28 01:25:41 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-40b86f10-d216-4f92-b9b7-1e5633893c35 tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-f8917ef6-1e52-4ca3-b559-615cc1e1e511-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:42 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683" returned: 0 in 0.468s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:42 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683 is being set with open permissions: ugo+rw
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:42 devstack sudo[87691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683
Feb 28 01:25:42 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "cinder-8486912f-2723-4903-b891-59c6b94c289e-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-8486912f-2723-4903-b891-59c6b94c289e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=246,cinder:INSERT=63,cinder:UPDATE=265,cinder:DELETE=22 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "cinder-quobyte-8486912f-2723-4903-b891-59c6b94c289e" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-quobyte-8486912f-2723-4903-b891-59c6b94c289e" acquired by "delete_volume" :: waited 0.014s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7503f8-cee4-426b-8377-fbda5966886f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:42 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e
Feb 28 01:25:42 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:42 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683" returned: 0 in 0.447s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.464s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-a5ee638d-a9bd-401e-81a3-3d5533162884-19c6621c-cb31-451c-8e6c-3b31fb65e762" by "_create_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:42 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7e8a7897-5bf5-4bd4-9552-f3479f41ecfd tempest-SnapshotsActionsTest-1171305829 None] Create snapshot completed successfully
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-a5ee638d-a9bd-401e-81a3-3d5533162884-19c6621c-cb31-451c-8e6c-3b31fb65e762" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Creating volume 19c6621c-cb31-451c-8e6c-3b31fb65e762 from snapshot a5ee638d-a9bd-401e-81a3-3d5533162884 {{(pid=82470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-19c6621c-cb31-451c-8e6c-3b31fb65e762" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-19c6621c-cb31-451c-8e6c-3b31fb65e762" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] snapshot: a5ee638d-a9bd-401e-81a3-3d5533162884, volume: 19c6621c-cb31-451c-8e6c-3b31fb65e762,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c35005-def2-4b20-b711-7cbd70e4f7e6]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:42 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884
Feb 28 01:25:42 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:42 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e" returned: 0 in 0.503s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:42 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e
Feb 28 01:25:42 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:43 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884" returned: 0 in 0.502s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0742cc0a-a4d6-4416-b442-4ea0e3185ff9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:43 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad
Feb 28 01:25:43 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:43 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8486912f-2723-4903-b891-59c6b94c289e" returned: 0 in 0.500s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-quobyte-8486912f-2723-4903-b891-59c6b94c289e" released by "delete_volume" :: held 1.029s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Created reservations ['ebbffd75-f5ef-46f2-ba4a-c6aef4e8affd', '9ea5ede2-06b3-4d2a-a624-dcff607a7a67', '15811332-7cab-4924-87f1-9b2f88637da0', '2ee9c110-433b-4613-b890-ba08af7be5b7'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:43 devstack sudo[87709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:43 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-e81a571b-5bb6-47a5-8c9b-a0096a613683-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-e81a571b-5bb6-47a5-8c9b-a0096a613683-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Acquiring lock "cinder-quobyte-e81a571b-5bb6-47a5-8c9b-a0096a613683" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-e81a571b-5bb6-47a5-8c9b-a0096a613683" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Deleting offline snapshot e81a571b-5bb6-47a5-8c9b-a0096a613683 of volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] snapshot_file for this snap is: volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a6ea58-8d77-42ac-9280-66174ea9e341]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:43 devstack sudo[87711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683
Feb 28 01:25:43 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:43 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" returned: 0 in 0.551s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762 not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:43 devstack sudo[87716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762
Feb 28 01:25:43 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Flow 'volume_create_manager' (3b95ba92-72cd-47a7-8a9c-14006c481ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1291bd1-e3b4-4262-9e48-61e1252d81f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1291bd1-e3b4-4262-9e48-61e1252d81f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1745516664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2a8f75-d49d-492a-8d05-0f12e440928c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4127f293e4d869335a1be69b7189f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:44Z,use_quota=True,user_id='4768950143b3476ea83fa068996d6e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef81cc5e-916b-4310-a749-f0a19b252760),volume_type_id=ef81cc5e-916b-4310-a749-f0a19b252760)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7b63ce-8bbb-4780-9e2e-2e9221587e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7b63ce-8bbb-4780-9e2e-2e9221587e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e246cbbf-8401-493d-8451-6c9dab3ababa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e246cbbf-8401-493d-8451-6c9dab3ababa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2a8f75-d49d-492a-8d05-0f12e440928c', 'volume_name': 'volume-7f2a8f75-d49d-492a-8d05-0f12e440928c', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45e5973-5647-4469-8854-f151028c0115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45e5973-5647-4469-8854-f151028c0115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4a2d0d-0177-4bb6-b09b-2b1d773b5b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:43 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Volume 7f2a8f75-d49d-492a-8d05-0f12e440928c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2a8f75-d49d-492a-8d05-0f12e440928c', 'volume_size': 1}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:43 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.527s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:43 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Deleted volume successfully.
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-12186aa4-d962-4353-81c0-f863d7515e7f tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-8486912f-2723-4903-b891-59c6b94c289e-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:44 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683" returned: 0 in 0.536s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9f8af-76b9-462d-af58-1139aec41409]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:44 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:44 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "cinder-ec155534-49cb-4afd-a7e2-50fb0961f3ba-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-ec155534-49cb-4afd-a7e2-50fb0961f3ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "cinder-quobyte-ec155534-49cb-4afd-a7e2-50fb0961f3ba" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-quobyte-ec155534-49cb-4afd-a7e2-50fb0961f3ba" acquired by "delete_volume" :: waited 0.023s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfdce85-a52e-4e60-9d6b-09d42d068efa]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:45 devstack sudo[87734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba
Feb 28 01:25:45 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:45 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 1.481s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:45 devstack sudo[87739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683
Feb 28 01:25:45 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:45 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba" returned: 0 in 1.030s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:45 devstack sudo[87744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba
Feb 28 01:25:45 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:46 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762" returned: 0 in 2.219s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[97695f88-61c3-42df-a84b-10322a7919b3]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:46 devstack sudo[87746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad
Feb 28 01:25:46 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:46 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683" returned: 0 in 0.655s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:46 devstack sudo[87751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683
Feb 28 01:25:46 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:46 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ec155534-49cb-4afd-a7e2-50fb0961f3ba" returned: 0 in 0.406s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-quobyte-ec155534-49cb-4afd-a7e2-50fb0961f3ba" released by "delete_volume" :: held 1.487s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Created reservations ['58b3439a-ba15-466f-85f5-0eabe838ff34', 'b3157389-0a3e-40bc-a279-dd1014affdf6', 'ca5a9f8b-c7de-443f-a765-e817f96b37bd', '5d880606-f26e-4342-8953-0f11d5248f4a'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:46 devstack sudo[87755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:46 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:46 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" returned: 0 in 0.630s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:25:46 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Converted 1024.00 MB image at 461.25 MB/s
Feb 28 01:25:46 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762 is being set with open permissions: ugo+rw
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:46 devstack sudo[87760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762
Feb 28 01:25:46 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:46 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.e81a571b-5bb6-47a5-8c9b-a0096a613683" returned: 0 in 0.442s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-e81a571b-5bb6-47a5-8c9b-a0096a613683" released by "_delete_snapshot" :: held 3.158s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" released by "delete_snapshot" :: held 3.169s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Created reservations ['8fe5eb53-a98d-4641-8c71-b0dd2544e4ad', 'c7067a03-3fb9-4114-bfdb-f5390282059b', 'b42d3029-2030-4f06-a8b2-76f93bb60bfb', 'c137203a-54be-4956-97a4-b971468e21f9'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:46 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Delete snapshot completed successfully.
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cf30662e-3dbd-4e48-b8a7-8fb4ff24d7eb tempest-SnapshotsActionsTest-1924179333 None] Lock "cinder-e81a571b-5bb6-47a5-8c9b-a0096a613683-delete_snapshot" released by "delete_snapshot" :: held 3.258s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:46 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.441s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:46 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Deleted volume successfully.
Feb 28 01:25:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-13f73861-7099-4d0a-9e35-ccad6ebc364c tempest-VolumesListTestJSON-1545212779 None] Lock "cinder-ec155534-49cb-4afd-a7e2-50fb0961f3ba-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:47 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762" returned: 0 in 0.463s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-19c6621c-cb31-451c-8e6c-3b31fb65e762" released by "_copy_volume_from_snapshot" :: held 4.421s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-a5ee638d-a9bd-401e-81a3-3d5533162884-19c6621c-cb31-451c-8e6c-3b31fb65e762" released by "_create_volume_from_snapshot" :: held 4.440s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.462s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.210s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1745516664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2a8f75-d49d-492a-8d05-0f12e440928c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4127f293e4d869335a1be69b7189f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:44Z,use_quota=True,user_id='4768950143b3476ea83fa068996d6e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef81cc5e-916b-4310-a749-f0a19b252760),volume_type_id=ef81cc5e-916b-4310-a749-f0a19b252760)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Creating volume 7f2a8f75-d49d-492a-8d05-0f12e440928c {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:47 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:47 devstack sudo[87764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c 1073741824
Feb 28 01:25:47 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7a774f-11ff-43c3-9a35-7c43776479a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c6621c-cb31-451c-8e6c-3b31fb65e762', 'volume_size': 1, 'snapshot_id': 'a5ee638d-a9bd-401e-81a3-3d5533162884'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f709eef8-d4bf-4eab-90f4-1b49b6bc9448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:47 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Volume volume-19c6621c-cb31-451c-8e6c-3b31fb65e762 (19c6621c-cb31-451c-8e6c-3b31fb65e762): created successfully
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f709eef8-d4bf-4eab-90f4-1b49b6bc9448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Flow 'volume_create_manager' (f0fd2dc0-7474-4ae4-9484-165d9aead3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:47 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-96883e76-c432-4ea7-89d0-e38e7a684664 tempest-VolumesSnapshotTestJSON-1782731118 None] Created volume successfully.
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-19c6621c-cb31-451c-8e6c-3b31fb65e762-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-19c6621c-cb31-451c-8e6c-3b31fb65e762-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-19c6621c-cb31-451c-8e6c-3b31fb65e762" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-19c6621c-cb31-451c-8e6c-3b31fb65e762" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d52c9c0-5183-4847-844e-26fbb064f251]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:47 devstack sudo[87769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762
Feb 28 01:25:47 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:47 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c 1073741824" returned: 0 in 0.556s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:47 devstack sudo[87772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c
Feb 28 01:25:47 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:48 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762" returned: 0 in 0.566s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "cinder-0222f3b4-ee72-478f-b508-6ca7e9c6b03b-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:48 devstack sudo[87777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762
Feb 28 01:25:48 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Lock "cinder-0222f3b4-ee72-478f-b508-6ca7e9c6b03b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "cinder-quobyte-0222f3b4-ee72-478f-b508-6ca7e9c6b03b" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Lock "cinder-quobyte-0222f3b4-ee72-478f-b508-6ca7e9c6b03b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Deleting offline snapshot 0222f3b4-ee72-478f-b508-6ca7e9c6b03b of volume 0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] snapshot_file for this snap is: volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e72f54-d792-4933-af60-09459e212197]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:48 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c" returned: 0 in 0.515s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4a2d0d-0177-4bb6-b09b-2b1d773b5b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2a8f75-d49d-492a-8d05-0f12e440928c', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed4fd3a-f01b-4f17-920a-939dd1da752a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:48 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Volume volume-7f2a8f75-d49d-492a-8d05-0f12e440928c (7f2a8f75-d49d-492a-8d05-0f12e440928c): created successfully
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed4fd3a-f01b-4f17-920a-939dd1da752a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Flow 'volume_create_manager' (3b95ba92-72cd-47a7-8a9c-14006c481ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:48 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-14f3f3b6-f713-4bfd-93ae-dd9a6bcee113 tempest-VolumeTypesAccessTest-818851749 None] Created volume successfully.
Feb 28 01:25:48 devstack sudo[87780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:48 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:48 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-19c6621c-cb31-451c-8e6c-3b31fb65e762" returned: 0 in 0.551s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-19c6621c-cb31-451c-8e6c-3b31fb65e762" released by "delete_volume" :: held 1.139s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Created reservations ['8a7ffb2f-6ee3-4ad1-b19f-27265a4f1f8f', '30d06d1b-c44a-4f5f-b4bb-741b2d9b3e58', '427d5a3d-4069-4c6e-9dfd-ce94dc9f75ac', '4b0c9b53-c17f-4d8f-889a-30a536e63c24'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:48 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.511s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[630d871d-3966-44fd-9d8b-8d2c59a10c93]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:48 devstack sudo[87787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:48 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:48 devstack sudo[87786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47
Feb 28 01:25:48 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Flow 'volume_create_manager' (ac305b45-e9b3-4508-ad79-9ccd891bf2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85350446-3ddb-4a73-b48d-f545275bf9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85350446-3ddb-4a73-b48d-f545275bf9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-377567999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c6813b-7c91-480a-9a29-4e63a608b2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cad915064e4072be604f792c3d05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:49Z,use_quota=True,user_id='365806eb43c341358f354580766129cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebd60ff-cf3c-4b3b-8ee4-af549b0ad357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebd60ff-cf3c-4b3b-8ee4-af549b0ad357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f97ee5f-45b7-46de-bd64-73475436f277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f97ee5f-45b7-46de-bd64-73475436f277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c6813b-7c91-480a-9a29-4e63a608b2b7', 'volume_name': 'volume-95c6813b-7c91-480a-9a29-4e63a608b2b7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3e2e36-dae9-4cbf-a938-a3947ca13bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3e2e36-dae9-4cbf-a938-a3947ca13bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590d942a-ba2f-4154-ab79-766087b12430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:48 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Volume 95c6813b-7c91-480a-9a29-4e63a608b2b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c6813b-7c91-480a-9a29-4e63a608b2b7', 'volume_size': 1}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-377567999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c6813b-7c91-480a-9a29-4e63a608b2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cad915064e4072be604f792c3d05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:25:49Z,use_quota=True,user_id='365806eb43c341358f354580766129cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Creating volume 95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:25:48 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:25:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:48 devstack sudo[87790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 1073741824
Feb 28 01:25:48 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Acquiring lock "cinder-7f2a8f75-d49d-492a-8d05-0f12e440928c-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Lock "cinder-7f2a8f75-d49d-492a-8d05-0f12e440928c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Acquiring lock "cinder-quobyte-7f2a8f75-d49d-492a-8d05-0f12e440928c" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:49 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.491s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Lock "cinder-quobyte-7f2a8f75-d49d-492a-8d05-0f12e440928c" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:49 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:49 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Deleted volume successfully.
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dadc438-f4d1-45cb-83f6-a93f57bc1f7e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47" returned: 0 in 0.551s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-baeb6cb1-a6f4-4df1-afaf-7b7abb6128c8 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-19c6621c-cb31-451c-8e6c-3b31fb65e762-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:49 devstack sudo[87797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:49 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:49 devstack sudo[87796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c
Feb 28 01:25:49 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:49 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 1073741824" returned: 0 in 0.507s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:49 devstack sudo[87803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7
Feb 28 01:25:49 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-a5ee638d-a9bd-401e-81a3-3d5533162884-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:49 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-a5ee638d-a9bd-401e-81a3-3d5533162884-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:49 devstack sudo[87811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b
Feb 28 01:25:49 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-a5ee638d-a9bd-401e-81a3-3d5533162884" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-a5ee638d-a9bd-401e-81a3-3d5533162884" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Deleting offline snapshot a5ee638d-a9bd-401e-81a3-3d5533162884 of volume 28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] snapshot_file for this snap is: volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e9dcb-4924-473e-921d-f57789dccdf9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:49 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c" returned: 0 in 0.546s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:49 devstack sudo[87814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c
Feb 28 01:25:49 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:49 devstack sudo[87813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884
Feb 28 01:25:49 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:49 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7" returned: 0 in 0.443s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590d942a-ba2f-4154-ab79-766087b12430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c6813b-7c91-480a-9a29-4e63a608b2b7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa0fe67-8571-49c8-b00b-0382619f192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:25:49 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Volume volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 (95c6813b-7c91-480a-9a29-4e63a608b2b7): created successfully
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa0fe67-8571-49c8-b00b-0382619f192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:25:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Flow 'volume_create_manager' (ac305b45-e9b3-4508-ad79-9ccd891bf2c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:25:49 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d15548ba-ec59-4fab-bf20-46e5eed20614 tempest-VolumesSnapshotListTestJSON-93283841 None] Created volume successfully.
Feb 28 01:25:50 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47.0222f3b4-ee72-478f-b508-6ca7e9c6b03b" returned: 0 in 0.402s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Lock "cinder-quobyte-0222f3b4-ee72-478f-b508-6ca7e9c6b03b" released by "_delete_snapshot" :: held 1.983s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" released by "delete_snapshot" :: held 2.001s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Created reservations ['c44cf7f9-52d6-4c14-adfb-fb795af560ad', '330e5ac1-ae06-4765-ba8c-8ec412adcb9b', '116223a7-0987-4aa7-bec7-26ca72b3fdf9', 'a1e9b499-bb5c-44cb-a083-0ddf079c0cf8'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:50 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Delete snapshot completed successfully.
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-94c0a367-54b5-44c1-973c-2f15ae7d8e85 tempest-SnapshotsActionsTest-1171305829 None] Lock "cinder-0222f3b4-ee72-478f-b508-6ca7e9c6b03b-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:50 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884" returned: 0 in 0.493s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:50 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7f2a8f75-d49d-492a-8d05-0f12e440928c" returned: 0 in 0.483s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3966d90b-6d6f-4e21-83d8-403b14314fde]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Lock "cinder-quobyte-7f2a8f75-d49d-492a-8d05-0f12e440928c" released by "delete_volume" :: held 1.063s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:50 devstack cinder-volume[82470]: WARNING cinder.quota [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1308053694 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1308053694, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:25:50 devstack cinder-volume[82470]: WARNING cinder.quota [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1308053694 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1308053694, it is now deprecated. Please use the default quota class for default quota.
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Created reservations ['2577e3bb-8542-4ba8-a538-140b2d059f63', '9fcd4c30-0a1a-4998-a359-caa833080fa9', 'e48b76e1-d746-4ea2-a8fa-d2695ced0b04', '00abc1fb-6529-48e5-9055-b38471cdd044'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:50 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad
Feb 28 01:25:50 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:50 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:50 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:50 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" returned: 0 in 0.459s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:50 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884
Feb 28 01:25:50 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:50 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.422s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:50 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Deleted volume successfully.
Feb 28 01:25:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-902357e3-a539-435b-aa80-1f1815dc0ac5 tempest-VolumeTypesAccessTest-818851749 None] Lock "cinder-7f2a8f75-d49d-492a-8d05-0f12e440928c-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Creating offline snapshot a0f9b375-4e93-441e-be66-ab2669ece58a of volume 95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c88b38-cf1f-4a27-952f-91e9646d62e6]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:51 devstack sudo[87833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7
Feb 28 01:25:51 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:51 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884" returned: 0 in 0.510s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:51 devstack sudo[87838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884
Feb 28 01:25:51 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "cinder-0fd06ba8-d7c4-4483-851b-4e46c2863b47-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Lock "cinder-0fd06ba8-d7c4-4483-851b-4e46c2863b47-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c21a3a-b655-47f9-94a7-1419e275d9c0]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:51 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47
Feb 28 01:25:51 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:51 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7" returned: 0 in 0.504s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:51 devstack sudo[87845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a 1G
Feb 28 01:25:51 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:51 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad.a5ee638d-a9bd-401e-81a3-3d5533162884" returned: 0 in 0.474s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-a5ee638d-a9bd-401e-81a3-3d5533162884" released by "_delete_snapshot" :: held 2.015s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" released by "delete_snapshot" :: held 2.025s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Created reservations ['227de28f-6ff6-48f1-ad5f-550aadc3a43f', '9e905384-fc62-4db1-aa14-44dbb30fc76f', '341f465c-14d5-46a9-a4a5-f2dc34b69ae8', '1eeb39d6-7b1e-4dc7-b730-0ee514927db8'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:51 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Delete snapshot completed successfully.
Feb 28 01:25:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3d867d06-6afc-4a26-8edf-2ee14fb379f4 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-a5ee638d-a9bd-401e-81a3-3d5533162884-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:52 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47" returned: 0 in 0.558s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:52 devstack sudo[87852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47
Feb 28 01:25:52 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:52 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a 1G" returned: 0 in 0.570s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:52 devstack sudo[87857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a
Feb 28 01:25:52 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:52 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0fd06ba8-d7c4-4483-851b-4e46c2863b47" returned: 0 in 0.519s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Lock "cinder-quobyte-0fd06ba8-d7c4-4483-851b-4e46c2863b47" released by "delete_volume" :: held 1.123s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Created reservations ['3a679622-b230-4127-94a1-6854c90bf828', '9d4e7b6a-cbe8-4d16-8722-d513e8523313', 'b3fa3f5d-3a68-4811-a3d6-ee1bf88ba573', '95157c23-3481-43d2-9b96-41b26b9dba49'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:52 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:52 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:52 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a" returned: 0 in 0.475s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:52 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a is being set with open permissions: ugo+rw
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:52 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a
Feb 28 01:25:52 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-28ece0fd-c6f7-4c9a-844d-b58c29d1abad-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-28ece0fd-c6f7-4c9a-844d-b58c29d1abad-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc0d5d3-5202-454d-9b6f-8edf5404a449]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:53 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a" returned: 0 in 0.424s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:53 devstack sudo[87868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad
Feb 28 01:25:53 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:53 devstack sudo[87871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.info
Feb 28 01:25:53 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:53 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.579s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:53 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Deleted volume successfully.
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b177fc6-98ba-46d6-a243-fc64c1065381 tempest-SnapshotsActionsTest-1171305829 None] Lock "cinder-0fd06ba8-d7c4-4483-851b-4e46c2863b47-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:53 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" returned: 0 in 0.560s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:53 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad
Feb 28 01:25:53 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:53 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.info" returned: 0 in 0.513s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:53 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.info is being set with open permissions: ugo+rw
Feb 28 01:25:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:53 devstack sudo[87879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.info
Feb 28 01:25:53 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:54 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" returned: 0 in 0.494s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-28ece0fd-c6f7-4c9a-844d-b58c29d1abad" released by "delete_volume" :: held 1.101s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Created reservations ['0a73f348-1173-4911-a558-554c2f32610b', 'ca8b8916-d651-492a-9792-a65ef90f2758', '100b8e6a-82ea-4d6e-86d6-fc34a9b420ee', '7d85e482-64ae-4412-bc23-fbedb8116eed'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:54 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.info" returned: 0 in 0.563s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:54 devstack sudo[87883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:54 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:54 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ebf7cfcb-6213-4e4e-b76b-91302ba1a6b4 tempest-VolumesSnapshotListTestJSON-93283841 None] Create snapshot completed successfully
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:54 devstack sudo[87885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:54 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:54 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:54 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.542s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:54 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Deleted volume successfully.
Feb 28 01:25:54 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2dc2f554-ec94-48d3-a3bd-e74347c6626e tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-28ece0fd-c6f7-4c9a-844d-b58c29d1abad-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-9774a2e9-9bbc-4a45-ad21-43399b84fd0a-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-9774a2e9-9bbc-4a45-ad21-43399b84fd0a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "cinder-quobyte-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34e9f5e-8762-409b-8953-ba6712276d80]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:55 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a
Feb 28 01:25:55 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] Creating offline snapshot cc1021e2-3fe7-4ac8-b030-41c9040788b1 of volume 95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f025b548-06e2-4bda-8c6c-92daadeefc30]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:55 devstack sudo[87891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a
Feb 28 01:25:55 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:56 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" returned: 0 in 0.684s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:56 devstack sudo[87896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a
Feb 28 01:25:56 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:56 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a" returned: 0 in 0.580s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c6813b-7c91-480a-9a29-4e63a608b2b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:56 devstack sudo[87901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 1G
Feb 28 01:25:56 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:56 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" returned: 0 in 0.625s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-quobyte-9774a2e9-9bbc-4a45-ad21-43399b84fd0a" released by "delete_volume" :: held 1.339s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Created reservations ['5b4f5ff2-14ac-489c-8af1-913de1ed5890', 'f2edff4c-3cbe-42cc-bb39-57bdec441e43', 'e1d23a7d-285e-40ee-8812-b3d74280a2a6', '842e6bf1-196d-43d7-9a6b-1562f8d91124'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:25:56 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 1G" returned: 0 in 0.555s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:56 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1
Feb 28 01:25:56 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:56 devstack sudo[87910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:25:56 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:57 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1" returned: 0 in 0.572s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:57 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 is being set with open permissions: ugo+rw
Feb 28 01:25:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:57 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.568s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:57 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:25:57 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Deleted volume successfully.
Feb 28 01:25:57 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1
Feb 28 01:25:57 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ad80acbe-009e-4199-86dc-4bcea1523270 tempest-VolumesSnapshotTestJSON-1782731118 None] Lock "cinder-9774a2e9-9bbc-4a45-ad21-43399b84fd0a-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:25:57 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1" returned: 0 in 0.448s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:25:57 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4199364a-4ff2-4d18-b827-3f93b6b8015b tempest-VolumesSnapshotListTestJSON-93283841 None] Create snapshot completed successfully
Feb 28 01:25:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:25:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:25:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] Creating offline snapshot 0fc0c773-b137-46dc-84f5-b374e4a9641c of volume 95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:25:58 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[787d5a62-688e-4802-9ee4-2265845d46c8]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:25:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:58 devstack sudo[87921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1
Feb 28 01:25:58 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:59 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1" returned: 0 in 0.521s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c6813b-7c91-480a-9a29-4e63a608b2b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:25:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:25:59 devstack sudo[87926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c 1G
Feb 28 01:25:59 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:25:59 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root
Feb 28 01:25:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c 1G" returned: 0 in 0.567s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:25:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:00 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c
Feb 28 01:26:00 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:00 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c" returned: 0 in 0.577s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:00 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c is being set with open permissions: ugo+rw
Feb 28 01:26:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:00 devstack sudo[87937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c
Feb 28 01:26:00 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:00 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c" returned: 0 in 0.436s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:01 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-be29230a-4182-47a6-9180-ffc7909a87d1 tempest-VolumesSnapshotListTestJSON-93283841 None] Create snapshot completed successfully
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Flow 'volume_create_manager' (c6bf5e33-61d9-40b3-8cca-04033f605059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65af3dd8-6403-4177-b744-1cc04d8e7ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65af3dd8-6403-4177-b744-1cc04d8e7ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1551923072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e3f5d4-c21d-4c04-be34-9d217e7ae89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0155ba51204a51b815fb798d9bed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:02Z,use_quota=True,user_id='4b2d279006c9407b96fc61708572baad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3ee654-5820-403c-b9f8-1edc6d87aee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3ee654-5820-403c-b9f8-1edc6d87aee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d172cc-1017-4515-9068-19665aa65a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d172cc-1017-4515-9068-19665aa65a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e3f5d4-c21d-4c04-be34-9d217e7ae89d', 'volume_name': 'volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73bc0d3-cd8d-451c-b993-1c8de020d17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73bc0d3-cd8d-451c-b993-1c8de020d17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b3d7b6-7fca-450a-a48d-46c9c42dc83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Volume f4e3f5d4-c21d-4c04-be34-9d217e7ae89d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d', 'volume_size': 1}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1551923072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e3f5d4-c21d-4c04-be34-9d217e7ae89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0155ba51204a51b815fb798d9bed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:02Z,use_quota=True,user_id='4b2d279006c9407b96fc61708572baad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Creating volume f4e3f5d4-c21d-4c04-be34-9d217e7ae89d {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:02 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:02 devstack sudo[87941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d 1073741824
Feb 28 01:26:02 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Flow 'volume_create_manager' (0dfd913e-7776-4ebf-9a11-55b61af8688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39a7f97-46c9-40a3-9e96-9f6814e1b61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39a7f97-46c9-40a3-9e96-9f6814e1b61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2086278947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b592aab0-77a8-49a4-a8fd-56a4dbf3e317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0155ba51204a51b815fb798d9bed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:02Z,use_quota=True,user_id='4b2d279006c9407b96fc61708572baad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fba274a-b070-400d-b706-6385faa4ff06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fba274a-b070-400d-b706-6385faa4ff06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e0c15d-163c-4cfe-9fbc-ea4b38daaa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e0c15d-163c-4cfe-9fbc-ea4b38daaa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b592aab0-77a8-49a4-a8fd-56a4dbf3e317', 'volume_name': 'volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269f9788-3ddd-424d-bf1f-6d7a4e53d60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269f9788-3ddd-424d-bf1f-6d7a4e53d60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35b6fd0-6873-49fb-ac44-27e000779cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Volume b592aab0-77a8-49a4-a8fd-56a4dbf3e317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317', 'volume_size': 1}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Flow 'volume_create_manager' (4e9bd7ec-3770-49da-9f38-0c2156736098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0929112-d7c5-4ecf-92af-04be85a9e27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-0fc0c773-b137-46dc-84f5-b374e4a9641c-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0929112-d7c5-4ecf-92af-04be85a9e27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1361505147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c5695c-5b64-4f5f-b122-3eddb476935a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0155ba51204a51b815fb798d9bed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:03Z,use_quota=True,user_id='4b2d279006c9407b96fc61708572baad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e3b2c6-0a43-4ccd-bf90-4e1f32b5f94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e3b2c6-0a43-4ccd-bf90-4e1f32b5f94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e6a6ba-82d9-4396-92a7-487054053d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e6a6ba-82d9-4396-92a7-487054053d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c5695c-5b64-4f5f-b122-3eddb476935a', 'volume_name': 'volume-89c5695c-5b64-4f5f-b122-3eddb476935a', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca6221d-c18a-4d60-9600-be940eeed0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca6221d-c18a-4d60-9600-be940eeed0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22391e48-9265-405d-a5e9-ca1b857d8884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:02 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Volume 89c5695c-5b64-4f5f-b122-3eddb476935a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c5695c-5b64-4f5f-b122-3eddb476935a', 'volume_size': 1}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-0fc0c773-b137-46dc-84f5-b374e4a9641c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d 1073741824" returned: 0 in 0.779s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-quobyte-0fc0c773-b137-46dc-84f5-b374e4a9641c" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-0fc0c773-b137-46dc-84f5-b374e4a9641c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Deleting offline snapshot 0fc0c773-b137-46dc-84f5-b374e4a9641c of volume 95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] snapshot_file for this snap is: volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc939974-1778-4f23-a5ee-783a576f428e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:03 devstack sudo[87947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d
Feb 28 01:26:03 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Flow 'volume_create_manager' (e5bdd0fa-06be-42de-805a-d96a969b7aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:03 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c
Feb 28 01:26:03 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad178f4f-0d83-4e9a-b7eb-5578bb9c2a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad178f4f-0d83-4e9a-b7eb-5578bb9c2a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1634301798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01404280-8d6a-49bb-9e26-14c1232aaed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0155ba51204a51b815fb798d9bed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:03Z,use_quota=True,user_id='4b2d279006c9407b96fc61708572baad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b559dd47-f55b-40bc-a2d5-77765fac6937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b559dd47-f55b-40bc-a2d5-77765fac6937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78266b6c-981b-4c48-8dec-10ad69c6588e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78266b6c-981b-4c48-8dec-10ad69c6588e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01404280-8d6a-49bb-9e26-14c1232aaed9', 'volume_name': 'volume-01404280-8d6a-49bb-9e26-14c1232aaed9', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c811997-3bf7-49f2-b069-ffacd81703cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c811997-3bf7-49f2-b069-ffacd81703cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5aa1ad-d48d-4c90-9895-8d515c483635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Volume 01404280-8d6a-49bb-9e26-14c1232aaed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01404280-8d6a-49bb-9e26-14c1232aaed9', 'volume_size': 1}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Flow 'volume_create_manager' (28981670-729a-4767-9c51-2b320cb261fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abe4a29-ab87-4c2e-b2b2-d10cde5d3ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abe4a29-ab87-4c2e-b2b2-d10cde5d3ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392322132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d7eaa2-1f75-4365-82a1-df46755b24d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0155ba51204a51b815fb798d9bed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:03Z,use_quota=True,user_id='4b2d279006c9407b96fc61708572baad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341d7177-5ec8-4a29-8f6b-814a12b946ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341d7177-5ec8-4a29-8f6b-814a12b946ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f930ddc-f69f-486f-bebf-a794368d6731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f930ddc-f69f-486f-bebf-a794368d6731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d7eaa2-1f75-4365-82a1-df46755b24d7', 'volume_name': 'volume-09d7eaa2-1f75-4365-82a1-df46755b24d7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5c4d3e-3349-490d-87c5-90a56c713a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5c4d3e-3349-490d-87c5-90a56c713a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14a0496-741d-4a43-9760-7d229fc11200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Volume 09d7eaa2-1f75-4365-82a1-df46755b24d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d7eaa2-1f75-4365-82a1-df46755b24d7', 'volume_size': 1}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:03 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d" returned: 0 in 0.590s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2086278947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b592aab0-77a8-49a4-a8fd-56a4dbf3e317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0155ba51204a51b815fb798d9bed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:02Z,use_quota=True,user_id='4b2d279006c9407b96fc61708572baad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Creating volume b592aab0-77a8-49a4-a8fd-56a4dbf3e317 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:03 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b3d7b6-7fca-450a-a48d-46c9c42dc83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c456d3-e78b-4a7a-9cc8-86a7a2601b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:03 devstack sudo[87951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317 1073741824
Feb 28 01:26:03 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:03 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Volume volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d (f4e3f5d4-c21d-4c04-be34-9d217e7ae89d): created successfully
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c456d3-e78b-4a7a-9cc8-86a7a2601b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Flow 'volume_create_manager' (c6bf5e33-61d9-40b3-8cca-04033f605059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:03 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e2236639-7d3c-49e6-8c6f-29c97c57e8ef tempest-CreateVolumesFromImageTest-843504156 None] Created volume successfully.
Feb 28 01:26:03 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c" returned: 0 in 0.808s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c6813b-7c91-480a-9a29-4e63a608b2b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1bd37f-a8d2-4285-a99b-0660d27ead3c]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:03 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1
Feb 28 01:26:03 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Flow 'volume_create_manager' (842ebca7-04fd-41ef-9171-0202a195f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c605c9-5202-4f0f-ab39-5ef3178d90e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c605c9-5202-4f0f-ab39-5ef3178d90e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1767423604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd83a75-88d1-4736-8f2d-da70c13a7d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab227d6d57a14c6cba1e2f5b30161ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:04Z,use_quota=True,user_id='27044faaab1a4fc7935d92f0dded4794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5427c9b2-07e3-40f8-9c62-d5dac13c17cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5427c9b2-07e3-40f8-9c62-d5dac13c17cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94646790-fe44-438b-89af-6c2627c458ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94646790-fe44-438b-89af-6c2627c458ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd83a75-88d1-4736-8f2d-da70c13a7d07', 'volume_name': 'volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8477008-2b05-4e42-9bb4-3778aefffb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8477008-2b05-4e42-9bb4-3778aefffb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af560305-2c26-4e10-98d8-78bc788841d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:04 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Volume 2cd83a75-88d1-4736-8f2d-da70c13a7d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07', 'volume_size': 1}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:04 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317 1073741824" returned: 0 in 0.638s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:04 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317
Feb 28 01:26:04 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:04 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1" returned: 0 in 0.630s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c6813b-7c91-480a-9a29-4e63a608b2b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:04 devstack sudo[87966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c
Feb 28 01:26:04 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:04 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317" returned: 0 in 0.439s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.820s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1361505147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c5695c-5b64-4f5f-b122-3eddb476935a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0155ba51204a51b815fb798d9bed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:03Z,use_quota=True,user_id='4b2d279006c9407b96fc61708572baad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Creating volume 89c5695c-5b64-4f5f-b122-3eddb476935a {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:04 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35b6fd0-6873-49fb-ac44-27e000779cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e917be3a-084f-49c6-9578-7d1fc35dfeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:04 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Volume volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317 (b592aab0-77a8-49a4-a8fd-56a4dbf3e317): created successfully
Feb 28 01:26:04 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a 1073741824
Feb 28 01:26:04 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e917be3a-084f-49c6-9578-7d1fc35dfeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Flow 'volume_create_manager' (0dfd913e-7776-4ebf-9a11-55b61af8688e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:04 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-53ef6c43-6a52-42d0-8c43-9da95b6a18aa tempest-CreateVolumesFromImageTest-843504156 None] Created volume successfully.
Feb 28 01:26:05 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c" returned: 0 in 0.531s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:05 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c
Feb 28 01:26:05 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:05 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a 1073741824" returned: 0 in 0.523s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:05 devstack sudo[87979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a
Feb 28 01:26:05 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:05 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.0fc0c773-b137-46dc-84f5-b374e4a9641c" returned: 0 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-0fc0c773-b137-46dc-84f5-b374e4a9641c" released by "_delete_snapshot" :: held 2.497s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" released by "delete_snapshot" :: held 2.512s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Created reservations ['33ad7456-c03f-4e2a-b21d-14ddc45dc883', 'f81edab1-662d-4413-981b-488ab52f37fe', '0593a588-eb1c-4d38-81c7-6c21756769c3', '7a117afb-dc49-4578-866b-8a86d066c9f8'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:05 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Delete snapshot completed successfully.
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-103220be-12f2-4138-a1f0-4fd4ce73f3f0 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-0fc0c773-b137-46dc-84f5-b374e4a9641c-delete_snapshot" released by "delete_snapshot" :: held 2.602s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:05 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a" returned: 0 in 0.454s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1634301798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01404280-8d6a-49bb-9e26-14c1232aaed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0155ba51204a51b815fb798d9bed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:03Z,use_quota=True,user_id='4b2d279006c9407b96fc61708572baad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Creating volume 01404280-8d6a-49bb-9e26-14c1232aaed9 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:05 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22391e48-9265-405d-a5e9-ca1b857d8884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c5695c-5b64-4f5f-b122-3eddb476935a', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:05 devstack sudo[87983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9 1073741824
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bac027-3ec4-484b-9957-c81967218e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:05 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:05 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Volume volume-89c5695c-5b64-4f5f-b122-3eddb476935a (89c5695c-5b64-4f5f-b122-3eddb476935a): created successfully
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bac027-3ec4-484b-9957-c81967218e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Flow 'volume_create_manager' (4e9bd7ec-3770-49da-9f38-0c2156736098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:05 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-bfdfa6ba-1791-45a5-9bb5-a0a008c250a0 tempest-CreateVolumesFromImageTest-843504156 None] Created volume successfully.
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-cc1021e2-3fe7-4ac8-b030-41c9040788b1-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-cc1021e2-3fe7-4ac8-b030-41c9040788b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-quobyte-cc1021e2-3fe7-4ac8-b030-41c9040788b1" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-cc1021e2-3fe7-4ac8-b030-41c9040788b1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Deleting offline snapshot cc1021e2-3fe7-4ac8-b030-41c9040788b1 of volume 95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] snapshot_file for this snap is: volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ac830-cc32-4897-bb56-2273dbbe1137]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:06 devstack sudo[87985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1
Feb 28 01:26:06 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:06 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9 1073741824" returned: 0 in 0.517s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:06 devstack sudo[87990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9
Feb 28 01:26:06 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:06 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1" returned: 0 in 0.570s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c6813b-7c91-480a-9a29-4e63a608b2b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d8f3b8-437b-42b9-b02e-7c39068977fb]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:06 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a
Feb 28 01:26:06 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:06 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9" returned: 0 in 0.555s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.339s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392322132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d7eaa2-1f75-4365-82a1-df46755b24d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0155ba51204a51b815fb798d9bed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:03Z,use_quota=True,user_id='4b2d279006c9407b96fc61708572baad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Creating volume 09d7eaa2-1f75-4365-82a1-df46755b24d7 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:06 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:06 devstack sudo[87998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7 1073741824
Feb 28 01:26:06 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5aa1ad-d48d-4c90-9895-8d515c483635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01404280-8d6a-49bb-9e26-14c1232aaed9', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6602cb2a-5cef-4653-bd2b-7a684ee1697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:06 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Volume volume-01404280-8d6a-49bb-9e26-14c1232aaed9 (01404280-8d6a-49bb-9e26-14c1232aaed9): created successfully
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6602cb2a-5cef-4653-bd2b-7a684ee1697d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Flow 'volume_create_manager' (e5bdd0fa-06be-42de-805a-d96a969b7aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:06 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-fb59a7e1-4ace-48ec-b95b-ed7de146da6c tempest-CreateVolumesFromImageTest-843504156 None] Created volume successfully.
Feb 28 01:26:07 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a" returned: 0 in 0.546s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c6813b-7c91-480a-9a29-4e63a608b2b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:26:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:07 devstack sudo[88003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1
Feb 28 01:26:07 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:07 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7 1073741824" returned: 0 in 0.556s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:07 devstack sudo[88008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7
Feb 28 01:26:07 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:07 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1" returned: 0 in 0.533s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:07 devstack sudo[88013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1
Feb 28 01:26:07 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:08 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7" returned: 0 in 0.539s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.834s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1767423604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd83a75-88d1-4736-8f2d-da70c13a7d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab227d6d57a14c6cba1e2f5b30161ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:04Z,use_quota=True,user_id='27044faaab1a4fc7935d92f0dded4794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Creating volume 2cd83a75-88d1-4736-8f2d-da70c13a7d07 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:08 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14a0496-741d-4a43-9760-7d229fc11200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d7eaa2-1f75-4365-82a1-df46755b24d7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:08 devstack sudo[88016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07 1073741824
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca0d38c-721a-4791-92a9-49b70aa5a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:08 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:08 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Volume volume-09d7eaa2-1f75-4365-82a1-df46755b24d7 (09d7eaa2-1f75-4365-82a1-df46755b24d7): created successfully
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca0d38c-721a-4791-92a9-49b70aa5a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Flow 'volume_create_manager' (28981670-729a-4767-9c51-2b320cb261fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:08 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-63d9c57a-eef5-46d6-87ba-2be3faa87934 tempest-CreateVolumesFromImageTest-843504156 None] Created volume successfully.
Feb 28 01:26:08 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.cc1021e2-3fe7-4ac8-b030-41c9040788b1" returned: 0 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-cc1021e2-3fe7-4ac8-b030-41c9040788b1" released by "_delete_snapshot" :: held 2.158s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" released by "delete_snapshot" :: held 2.169s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Created reservations ['3f8c1c36-316d-4901-b82b-1c682344c59e', 'bd8055b9-ece7-485e-a6ca-0314777dc0e0', '8ff848bc-e663-412e-919f-f6aacabdf367', 'e664afe6-3857-4daf-a72a-b7c0abf8b272'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:08 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Delete snapshot completed successfully.
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2beab823-3ce0-4d8f-a78e-db8b8362dc5e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-cc1021e2-3fe7-4ac8-b030-41c9040788b1-delete_snapshot" released by "delete_snapshot" :: held 2.254s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Flow 'volume_create_manager' (b50c6e7a-3034-4193-8230-8986c9aa10c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3add78e0-3c75-40af-8435-6441fba58bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3add78e0-3c75-40af-8435-6441fba58bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-259388674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1451d79-46f4-42a6-bacf-a5929fc51823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9197386b909440be98c54e3b09f490fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:08Z,use_quota=True,user_id='5c8161e8a5684ff48f839e27f5f00e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8051e81-79fd-4bc6-8d36-4f15bcc2a741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8051e81-79fd-4bc6-8d36-4f15bcc2a741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eca390e-1ff0-438a-bc40-aac9c51efd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eca390e-1ff0-438a-bc40-aac9c51efd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1451d79-46f4-42a6-bacf-a5929fc51823', 'volume_name': 'volume-e1451d79-46f4-42a6-bacf-a5929fc51823', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533dd1dc-52a6-4a26-aa9a-53ea73a80db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533dd1dc-52a6-4a26-aa9a-53ea73a80db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b4fd47-a951-4e02-a8f5-a1d466046e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:08 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Volume e1451d79-46f4-42a6-bacf-a5929fc51823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1451d79-46f4-42a6-bacf-a5929fc51823', 'volume_size': 1}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:08 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07 1073741824" returned: 0 in 0.518s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:08 devstack sudo[88022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07
Feb 28 01:26:08 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "cinder-09d7eaa2-1f75-4365-82a1-df46755b24d7-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-09d7eaa2-1f75-4365-82a1-df46755b24d7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:08 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07" returned: 0 in 0.417s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-259388674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1451d79-46f4-42a6-bacf-a5929fc51823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9197386b909440be98c54e3b09f490fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:08Z,use_quota=True,user_id='5c8161e8a5684ff48f839e27f5f00e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Creating volume e1451d79-46f4-42a6-bacf-a5929fc51823 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:09 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "cinder-quobyte-09d7eaa2-1f75-4365-82a1-df46755b24d7" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af560305-2c26-4e10-98d8-78bc788841d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:09 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823 1073741824
Feb 28 01:26:09 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb48e96-f797-44bc-9f5a-2fc7ce2960dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:09 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Volume volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07 (2cd83a75-88d1-4736-8f2d-da70c13a7d07): created successfully
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb48e96-f797-44bc-9f5a-2fc7ce2960dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Flow 'volume_create_manager' (842ebca7-04fd-41ef-9171-0202a195f90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-quobyte-09d7eaa2-1f75-4365-82a1-df46755b24d7" acquired by "delete_volume" :: waited 0.030s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd90d3ed-c227-4a08-9eb3-9ff63116f004]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:09 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7e600ffe-37ce-428d-a831-169b128576f2 tempest-VolumesTransfersV355Test-720936324 None] Created volume successfully.
Feb 28 01:26:09 devstack sudo[88027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7
Feb 28 01:26:09 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-a0f9b375-4e93-441e-be66-ab2669ece58a-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-a0f9b375-4e93-441e-be66-ab2669ece58a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-quobyte-a0f9b375-4e93-441e-be66-ab2669ece58a" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-a0f9b375-4e93-441e-be66-ab2669ece58a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Deleting offline snapshot a0f9b375-4e93-441e-be66-ab2669ece58a of volume 95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] snapshot_file for this snap is: volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e6031-1960-4877-9fd9-96b15ef1f283]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:09 devstack sudo[88029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a
Feb 28 01:26:09 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:09 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823 1073741824" returned: 0 in 0.516s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:09 devstack sudo[88037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823
Feb 28 01:26:09 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:09 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7" returned: 0 in 0.542s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:09 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7
Feb 28 01:26:09 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:09 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a" returned: 0 in 0.538s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c6813b-7c91-480a-9a29-4e63a608b2b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[85218321-7fb7-4a6f-89c4-564b30fe17c2]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:09 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-05296f01-59cf-4143-970e-c77900e71f96 tempest-VolumesTransfersV355Test-855028322 None] Transfer volume completed successfully.
Feb 28 01:26:09 devstack sudo[88044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7
Feb 28 01:26:09 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:09 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823" returned: 0 in 0.408s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b4fd47-a951-4e02-a8f5-a1d466046e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1451d79-46f4-42a6-bacf-a5929fc51823', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a33d28b-4220-4c28-8d34-bba2b5ec1f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:09 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Volume volume-e1451d79-46f4-42a6-bacf-a5929fc51823 (e1451d79-46f4-42a6-bacf-a5929fc51823): created successfully
Feb 28 01:26:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a33d28b-4220-4c28-8d34-bba2b5ec1f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Flow 'volume_create_manager' (b50c6e7a-3034-4193-8230-8986c9aa10c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:10 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3175ac73-1fd3-44b1-a0e4-2f5cc9471a01 tempest-VolumeQuotasNegativeTestJSON-344907896 None] Created volume successfully.
Feb 28 01:26:10 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-09d7eaa2-1f75-4365-82a1-df46755b24d7" returned: 0 in 0.485s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-quobyte-09d7eaa2-1f75-4365-82a1-df46755b24d7" released by "delete_volume" :: held 1.048s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Created reservations ['c628524b-174f-4ab8-a515-825e9fc27594', '0925b512-169c-44b7-9e06-c2c8a2c84df4', '1a9f391a-9f28-4d06-b759-e616b2b988b2', '8ba5506d-3c14-4358-a4d6-1fc8f7696aee'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:10 devstack sudo[88049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:10 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:10 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7" returned: 0 in 0.489s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:10 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a
Feb 28 01:26:10 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:10 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.454s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:10 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Deleted volume successfully.
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a20ed27-6602-431f-a1ba-80a940a91139 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-09d7eaa2-1f75-4365-82a1-df46755b24d7-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Acquiring lock "cinder-2cd83a75-88d1-4736-8f2d-da70c13a7d07-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Lock "cinder-2cd83a75-88d1-4736-8f2d-da70c13a7d07-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Acquiring lock "cinder-quobyte-2cd83a75-88d1-4736-8f2d-da70c13a7d07" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Lock "cinder-quobyte-2cd83a75-88d1-4736-8f2d-da70c13a7d07" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:10 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a" returned: 0 in 0.496s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed746141-51ae-4dfa-ba16-75c10b18d1b5]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:10 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a
Feb 28 01:26:10 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:10 devstack sudo[88060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07
Feb 28 01:26:10 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Acquiring lock "cinder-e1451d79-46f4-42a6-bacf-a5929fc51823-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Lock "cinder-e1451d79-46f4-42a6-bacf-a5929fc51823-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Acquiring lock "cinder-quobyte-e1451d79-46f4-42a6-bacf-a5929fc51823" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "cinder-01404280-8d6a-49bb-9e26-14c1232aaed9-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Lock "cinder-quobyte-e1451d79-46f4-42a6-bacf-a5929fc51823" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-01404280-8d6a-49bb-9e26-14c1232aaed9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4fcb85-6004-4bb8-b203-0660440ba6a4]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:11 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "cinder-quobyte-01404280-8d6a-49bb-9e26-14c1232aaed9" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7.a0f9b375-4e93-441e-be66-ab2669ece58a" returned: 0 in 0.459s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-quobyte-01404280-8d6a-49bb-9e26-14c1232aaed9" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb161b1-ba0c-4811-a885-2c49b0ef785b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-a0f9b375-4e93-441e-be66-ab2669ece58a" released by "_delete_snapshot" :: held 2.069s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" released by "delete_snapshot" :: held 2.087s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:11 devstack sudo[88064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823
Feb 28 01:26:11 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Created reservations ['00bdc74b-9c67-4636-adb2-cfef72fa4cb9', '933ca994-1012-45f8-8a02-02aed6ea7c35', 'c3123a1c-6704-4dcf-929a-dc74ad5242c1', '6217ad92-4ad8-4b86-98e5-aaa1142aea98'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:11 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07" returned: 0 in 0.553s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:11 devstack sudo[88068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9
Feb 28 01:26:11 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:11 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07
Feb 28 01:26:11 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:11 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Delete snapshot completed successfully.
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a4e48cdc-af51-4273-a35e-8481b58d2c2e tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-a0f9b375-4e93-441e-be66-ab2669ece58a-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:11 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823" returned: 0 in 0.496s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:11 devstack sudo[88080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823
Feb 28 01:26:11 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:11 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9" returned: 0 in 0.470s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:11 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2cd83a75-88d1-4736-8f2d-da70c13a7d07" returned: 0 in 0.419s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:11 devstack sudo[88083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9
Feb 28 01:26:11 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Lock "cinder-quobyte-2cd83a75-88d1-4736-8f2d-da70c13a7d07" released by "delete_volume" :: held 1.017s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Created reservations ['66f0b926-ced6-4c5d-832a-347cabbc8b2c', '61061dc2-2195-47af-816b-7deb035fe1d2', '4600e9d3-f354-4206-a813-f1bc29cca501', 'ccd08402-f7d4-47d0-8d13-bc9f10239003'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:11 devstack sudo[88085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:11 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:12 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e1451d79-46f4-42a6-bacf-a5929fc51823" returned: 0 in 0.409s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Lock "cinder-quobyte-e1451d79-46f4-42a6-bacf-a5929fc51823" released by "delete_volume" :: held 0.934s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Created reservations ['d5f41ca0-22b0-422a-beaa-86e427344d8b', '08b1e3af-a26d-4735-8112-3a84f06b04b8', '734d5168-151d-478e-bee7-8229141d97cf', '224507b4-ebb5-4a9b-ae25-67b6fbc75b4d'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:12 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-01404280-8d6a-49bb-9e26-14c1232aaed9" returned: 0 in 0.393s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-quobyte-01404280-8d6a-49bb-9e26-14c1232aaed9" released by "delete_volume" :: held 0.922s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:12 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:12 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Created reservations ['7f47e80a-a8d9-4bb0-a6e3-3ab5ecd5d0c2', '1c5c3fbf-e161-422b-bcbd-62efdfd6e325', 'e04c692f-b8b4-400b-a558-bf493d790064', '03d1ecfd-ce07-47fd-aa72-4f91fae722f0'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:12 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.394s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:12 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Deleted volume successfully.
Feb 28 01:26:12 devstack sudo[88092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:12 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe65594-e819-4028-b0c0-f17b18190fe4 tempest-VolumesTransfersV355Test-272675528 None] Lock "cinder-2cd83a75-88d1-4736-8f2d-da70c13a7d07-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "cinder-89c5695c-5b64-4f5f-b122-3eddb476935a-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-89c5695c-5b64-4f5f-b122-3eddb476935a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "cinder-quobyte-89c5695c-5b64-4f5f-b122-3eddb476935a" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-quobyte-89c5695c-5b64-4f5f-b122-3eddb476935a" acquired by "delete_volume" :: waited 0.014s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45f516c-3992-49a6-b374-cfe14aedd739]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-95c6813b-7c91-480a-9a29-4e63a608b2b7-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-95c6813b-7c91-480a-9a29-4e63a608b2b7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[df52e978-f4c2-4abd-b6b9-b7d6f4d46340]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:12 devstack sudo[88094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a
Feb 28 01:26:12 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:12 devstack sudo[88095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7
Feb 28 01:26:12 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:12 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.564s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:12 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Deleted volume successfully.
Feb 28 01:26:12 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.666s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-25a31b88-3289-4873-b870-8b68d7f14f12 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-01404280-8d6a-49bb-9e26-14c1232aaed9-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:12 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Deleted volume successfully.
Feb 28 01:26:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-62c71034-d105-40a3-b507-f779f85ca43f tempest-VolumeQuotasNegativeTestJSON-344907896 None] Lock "cinder-e1451d79-46f4-42a6-bacf-a5929fc51823-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:13 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a" returned: 0 in 0.652s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:13 devstack sudo[88103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a
Feb 28 01:26:13 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Flow 'volume_create_manager' (75553564-11d4-4835-9b03-3801f8a7d15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a80957b-3caf-4696-91c0-96d3962dc526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a80957b-3caf-4696-91c0-96d3962dc526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2081288685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d51853-0f35-4c0d-a7b9-a56f8c2eca04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab227d6d57a14c6cba1e2f5b30161ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:13Z,use_quota=True,user_id='27044faaab1a4fc7935d92f0dded4794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802d0ff7-1474-475a-b18f-dd4502d3c372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802d0ff7-1474-475a-b18f-dd4502d3c372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd5bd47-cffa-4829-ae8c-7a44e0605445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd5bd47-cffa-4829-ae8c-7a44e0605445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d51853-0f35-4c0d-a7b9-a56f8c2eca04', 'volume_name': 'volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ae7a6b-a5ff-45ed-bff2-232deb752518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ae7a6b-a5ff-45ed-bff2-232deb752518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b98f8fa-2872-41f6-a196-8599f4a92202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:13 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Volume 16d51853-0f35-4c0d-a7b9-a56f8c2eca04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04', 'volume_size': 1}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2081288685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d51853-0f35-4c0d-a7b9-a56f8c2eca04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab227d6d57a14c6cba1e2f5b30161ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:13Z,use_quota=True,user_id='27044faaab1a4fc7935d92f0dded4794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Creating volume 16d51853-0f35-4c0d-a7b9-a56f8c2eca04 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:13 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:13 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04 1073741824
Feb 28 01:26:13 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:13 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7" returned: 0 in 0.773s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:13 devstack sudo[88110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7
Feb 28 01:26:13 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:13 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89c5695c-5b64-4f5f-b122-3eddb476935a" returned: 0 in 0.517s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-quobyte-89c5695c-5b64-4f5f-b122-3eddb476935a" released by "delete_volume" :: held 1.202s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Created reservations ['f54235c0-a5cb-4c5a-9a9b-ccac2fb99f6b', 'c10d730e-aa4d-4a08-aa96-17f7c3c75fcd', 'a6538e7f-5063-4d39-9634-ffbe787d35e5', '9cae182d-8ca5-4c7e-8fd4-63f0ee36c3d7'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:13 devstack sudo[88113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:13 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:13 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-95c6813b-7c91-480a-9a29-4e63a608b2b7" returned: 0 in 0.564s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-quobyte-95c6813b-7c91-480a-9a29-4e63a608b2b7" released by "delete_volume" :: held 1.365s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:13 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04 1073741824" returned: 0 in 0.620s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:13 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04
Feb 28 01:26:13 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:13 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Created reservations ['92f6a8b7-d57d-4aa3-9eb7-45c34abcd2e1', 'af5af68f-9950-47ff-b428-7975a6ecf55c', 'bf39fecc-8095-4d1f-8d2e-1b8c54bf9495', '6b8b350b-9df3-407c-9701-50cb4d0373f6'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:14 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:14 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:14 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.468s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:14 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Deleted volume successfully.
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-61f9bc29-be85-4006-9a5b-cf00837753b7 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-89c5695c-5b64-4f5f-b122-3eddb476935a-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:14 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04" returned: 0 in 0.443s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b98f8fa-2872-41f6-a196-8599f4a92202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92351a55-28a5-419f-9cff-20e5b39805a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:14 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Volume volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04 (16d51853-0f35-4c0d-a7b9-a56f8c2eca04): created successfully
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92351a55-28a5-419f-9cff-20e5b39805a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Flow 'volume_create_manager' (75553564-11d4-4835-9b03-3801f8a7d15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:14 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-96b840ed-fda3-4d71-8674-378cd5e74661 tempest-VolumesTransfersV355Test-720936324 None] Created volume successfully.
Feb 28 01:26:14 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.471s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:14 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Deleted volume successfully.
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c47c64d2-0f24-4edd-8b85-aafbb0b4da14 tempest-VolumesSnapshotListTestJSON-93283841 None] Lock "cinder-95c6813b-7c91-480a-9a29-4e63a608b2b7-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "cinder-b592aab0-77a8-49a4-a8fd-56a4dbf3e317-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-b592aab0-77a8-49a4-a8fd-56a4dbf3e317-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "cinder-quobyte-b592aab0-77a8-49a4-a8fd-56a4dbf3e317" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-quobyte-b592aab0-77a8-49a4-a8fd-56a4dbf3e317" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f01c85-bc65-4887-9e2f-4c00704bed1f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:14 devstack sudo[88126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317
Feb 28 01:26:14 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:15 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317" returned: 0 in 0.518s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:15 devstack sudo[88131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317
Feb 28 01:26:15 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:15 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b592aab0-77a8-49a4-a8fd-56a4dbf3e317" returned: 0 in 0.476s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-quobyte-b592aab0-77a8-49a4-a8fd-56a4dbf3e317" released by "delete_volume" :: held 1.018s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Acquiring lock "cinder-16d51853-0f35-4c0d-a7b9-a56f8c2eca04-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Lock "cinder-16d51853-0f35-4c0d-a7b9-a56f8c2eca04-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Created reservations ['acfed12f-aeef-4d7e-83bb-2af0e1433895', '8e0ce620-22c3-41ef-a796-15a523dedb7d', 'fe23f450-86bd-4042-b354-1c6348796fbc', '0356b6ea-494e-4d4d-9ba7-b84d3b7346c7'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Acquiring lock "cinder-quobyte-16d51853-0f35-4c0d-a7b9-a56f8c2eca04" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Lock "cinder-quobyte-16d51853-0f35-4c0d-a7b9-a56f8c2eca04" acquired by "delete_volume" :: waited 0.018s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4245d1e-e7d5-4465-ac4c-f2b695efb52f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:15 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04
Feb 28 01:26:15 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:15 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:15 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Flow 'volume_create_manager' (8518551d-951a-46c2-a548-d418c960e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a1e6f5-bad9-4fe6-8f0e-6d5622b9fd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a1e6f5-bad9-4fe6-8f0e-6d5622b9fd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2085744995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36ebc13-8dad-403b-8902-c618dfe2f35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099e820e0d9c4f08aa37b8273eb50628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:16Z,use_quota=True,user_id='ab53b636a18e4c91a994a1b04195e220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442b2efe-2c28-4be7-896b-126fc71edfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442b2efe-2c28-4be7-896b-126fc71edfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbaa4c52-af92-4772-9a1d-75c7d8bef96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbaa4c52-af92-4772-9a1d-75c7d8bef96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b36ebc13-8dad-403b-8902-c618dfe2f35e', 'volume_name': 'volume-b36ebc13-8dad-403b-8902-c618dfe2f35e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a445c1-88d7-45b8-b0a7-6f17cf7045ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a445c1-88d7-45b8-b0a7-6f17cf7045ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9238854f-c672-4c95-af4d-38828af65288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:15 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Volume b36ebc13-8dad-403b-8902-c618dfe2f35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b36ebc13-8dad-403b-8902-c618dfe2f35e', 'volume_size': 1}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2085744995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36ebc13-8dad-403b-8902-c618dfe2f35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099e820e0d9c4f08aa37b8273eb50628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:16Z,use_quota=True,user_id='ab53b636a18e4c91a994a1b04195e220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Creating volume b36ebc13-8dad-403b-8902-c618dfe2f35e {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:15 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:15 devstack sudo[88138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e 1073741824
Feb 28 01:26:15 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:16 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.462s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:16 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Deleted volume successfully.
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-962611ac-3ac7-452b-8103-a02f5639b0bb tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-b592aab0-77a8-49a4-a8fd-56a4dbf3e317-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:16 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04" returned: 0 in 0.565s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:16 devstack sudo[88146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04
Feb 28 01:26:16 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:16 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e 1073741824" returned: 0 in 0.546s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:16 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e
Feb 28 01:26:16 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (51fe4fd6-2c93-49e7-9692-6b409ffe9884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f302af-bcf8-453d-b0a2-ac1fc060f044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f302af-bcf8-453d-b0a2-ac1fc060f044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2116833456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43a1943-14a6-4eda-9755-8e843a9b13d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:17Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5d141c-d3b2-41dc-8bfa-bc9f11e91425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5d141c-d3b2-41dc-8bfa-bc9f11e91425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb42545c-c452-451d-8f46-3a6de32b6b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb42545c-c452-451d-8f46-3a6de32b6b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43a1943-14a6-4eda-9755-8e843a9b13d7', 'volume_name': 'volume-e43a1943-14a6-4eda-9755-8e843a9b13d7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e7d518-860f-4286-ac40-517f07ae78c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e7d518-860f-4286-ac40-517f07ae78c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dd43fd-17ab-4cc0-a5d6-c46f39e54221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:16 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume e43a1943-14a6-4eda-9755-8e843a9b13d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43a1943-14a6-4eda-9755-8e843a9b13d7', 'volume_size': 1}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:16 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-16d51853-0f35-4c0d-a7b9-a56f8c2eca04" returned: 0 in 0.440s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Lock "cinder-quobyte-16d51853-0f35-4c0d-a7b9-a56f8c2eca04" released by "delete_volume" :: held 1.045s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "cinder-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Created reservations ['11095c6f-83ae-4903-b5a6-25718405ac29', '00a671e3-b5d9-4fb1-9dea-9eed295f2dad', '3e0e20e9-107f-4806-a75c-f525474fde9c', '4a338670-b0cd-48ec-87f8-0804f3738e4e'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "cinder-quobyte-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-quobyte-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0280aa3-a1eb-4465-9805-fd19df90205c]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:16 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:16 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:16 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:16 devstack sudo[88153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d
Feb 28 01:26:16 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e" returned: 0 in 0.481s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.311s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2116833456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43a1943-14a6-4eda-9755-8e843a9b13d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:17Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Creating volume e43a1943-14a6-4eda-9755-8e843a9b13d7 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:16 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9238854f-c672-4c95-af4d-38828af65288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b36ebc13-8dad-403b-8902-c618dfe2f35e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e87099-39ad-4531-99af-1e826c0ffdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:16 devstack sudo[88157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7 1073741824
Feb 28 01:26:16 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:16 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Volume volume-b36ebc13-8dad-403b-8902-c618dfe2f35e (b36ebc13-8dad-403b-8902-c618dfe2f35e): created successfully
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e87099-39ad-4531-99af-1e826c0ffdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Flow 'volume_create_manager' (8518551d-951a-46c2-a548-d418c960e58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:16 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-a42fab09-8f24-4299-84da-5fbb097c2df5 tempest-VolumesServicesTestJSON-608024399 None] Created volume successfully.
Feb 28 01:26:17 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.395s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:17 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Deleted volume successfully.
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a8c4f2a-df93-42e5-8c5b-031fdcf1cf84 tempest-VolumesTransfersV355Test-272675528 None] Lock "cinder-16d51853-0f35-4c0d-a7b9-a56f8c2eca04-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:17 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d" returned: 0 in 0.459s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:17 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d
Feb 28 01:26:17 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:17 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7 1073741824" returned: 0 in 0.493s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:17 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7
Feb 28 01:26:17 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:17 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d" returned: 0 in 0.425s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-quobyte-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d" released by "delete_volume" :: held 0.909s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Created reservations ['74210e93-0d4a-46d1-aa8d-fe63f5fb0038', '6f354515-ccb0-4a5b-9501-9ec24a508cac', '85b4ebcb-4f39-4a62-93f7-7c342a865b88', '5cd4e59d-36e9-42fd-8f5f-c6513f10444e'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:17 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7" returned: 0 in 0.446s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:17 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:17 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dd43fd-17ab-4cc0-a5d6-c46f39e54221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43a1943-14a6-4eda-9755-8e843a9b13d7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739e9ece-bcb0-44bb-b393-3a505bd33b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:17 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume volume-e43a1943-14a6-4eda-9755-8e843a9b13d7 (e43a1943-14a6-4eda-9755-8e843a9b13d7): created successfully
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739e9ece-bcb0-44bb-b393-3a505bd33b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (51fe4fd6-2c93-49e7-9692-6b409ffe9884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:17 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d7c2372c-86ae-46e7-9dfe-cf31d8341bfc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created volume successfully.
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Acquiring lock "cinder-b36ebc13-8dad-403b-8902-c618dfe2f35e-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Lock "cinder-b36ebc13-8dad-403b-8902-c618dfe2f35e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Acquiring lock "cinder-quobyte-b36ebc13-8dad-403b-8902-c618dfe2f35e" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Lock "cinder-quobyte-b36ebc13-8dad-403b-8902-c618dfe2f35e" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa960b3a-b069-4eb1-be1b-c13b6c35199e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:18 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e
Feb 28 01:26:18 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:18 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.475s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:18 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Deleted volume successfully.
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-faf7390f-98fd-47b9-a4e6-6d0df6cf9985 tempest-CreateVolumesFromImageTest-843504156 None] Lock "cinder-f4e3f5d4-c21d-4c04-be34-9d217e7ae89d-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:18 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e" returned: 0 in 0.536s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:18 devstack sudo[88180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e
Feb 28 01:26:18 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:18 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (58ee83fa-eca8-4994-bdf3-bd041eede767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fceabd3-772f-43ea-9e12-d1ed0fc5bd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fceabd3-772f-43ea-9e12-d1ed0fc5bd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1867194704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1914d2b6-b07c-4677-9467-ec1531e5bcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:19Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d8e0ab-d39b-4c40-b904-c5bafa0d3982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d8e0ab-d39b-4c40-b904-c5bafa0d3982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e3c0f3-ec12-4539-ac8e-52f57586af4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e3c0f3-ec12-4539-ac8e-52f57586af4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1914d2b6-b07c-4677-9467-ec1531e5bcd9', 'volume_name': 'volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b169ba-dc98-46ee-8b88-833e9a97e2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b169ba-dc98-46ee-8b88-833e9a97e2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69cdf4a-24d2-4952-8b93-363b65fca026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume 1914d2b6-b07c-4677-9467-ec1531e5bcd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9', 'volume_size': 1}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1867194704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1914d2b6-b07c-4677-9467-ec1531e5bcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:19Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Creating volume 1914d2b6-b07c-4677-9467-ec1531e5bcd9 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:19 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:19 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9 1073741824
Feb 28 01:26:19 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:19 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b36ebc13-8dad-403b-8902-c618dfe2f35e" returned: 0 in 0.652s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (8632269a-fc48-4672-a0c9-9488455beb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1795785f-4e99-4525-bcd4-68994b4a6e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Lock "cinder-quobyte-b36ebc13-8dad-403b-8902-c618dfe2f35e" released by "delete_volume" :: held 1.259s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1795785f-4e99-4525-bcd4-68994b4a6e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938397550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf8d81f-c26b-42f3-955a-5f1ab587f53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:19Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6dec953-383f-4799-958e-6c14a0ee1550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6dec953-383f-4799-958e-6c14a0ee1550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1437b2-17e7-4526-9fb5-c2112151c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1437b2-17e7-4526-9fb5-c2112151c71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbf8d81f-c26b-42f3-955a-5f1ab587f53e', 'volume_name': 'volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592ee9ce-e4e2-4b30-b3bc-77f6cbf9e9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592ee9ce-e4e2-4b30-b3bc-77f6cbf9e9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334f99cf-215f-4ab4-aa85-432c7f3fa987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume bbf8d81f-c26b-42f3-955a-5f1ab587f53e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e', 'volume_size': 1}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Created reservations ['0c79d081-79de-4695-ac6a-175bc7423f63', '859dfe16-2656-4d9c-9dea-79a2a7cef8b3', '7683f588-c545-427f-8cef-7fec34d79ca1', '5751b7bb-325f-4bad-a976-aa972b6cc040'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:19 devstack sudo[88185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:19 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (d737975d-0087-418c-8a02-ee967f583658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce35078e-0c7d-4834-9203-cb8f0aab5a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce35078e-0c7d-4834-9203-cb8f0aab5a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164132680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a50200f-f2c4-4d48-8574-ff69f9fbeb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:20Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4407ccc3-30f5-453e-baab-120771e5dfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4407ccc3-30f5-453e-baab-120771e5dfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9ad985-f664-42f1-8d84-723333bee292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9ad985-f664-42f1-8d84-723333bee292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a50200f-f2c4-4d48-8574-ff69f9fbeb9c', 'volume_name': 'volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff67294-a47a-40e5-a172-e46ed5e438e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff67294-a47a-40e5-a172-e46ed5e438e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be27bf41-ec13-4157-8cfd-87eceba4908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume 9a50200f-f2c4-4d48-8574-ff69f9fbeb9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c', 'volume_size': 1}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:19 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9 1073741824" returned: 0 in 0.747s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:19 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9
Feb 28 01:26:19 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (3c2581bb-3f18-437b-a336-f9a0b03780ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ccb3ab-0608-472f-834d-d99d52dac27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ccb3ab-0608-472f-834d-d99d52dac27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-51071232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa41a9a-00db-47fd-8139-9ec815bcb8eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:20Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5a8c9b-95be-4383-a937-eee710adcab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5a8c9b-95be-4383-a937-eee710adcab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce35d36-2ed2-482b-9f4c-ff4221155bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce35d36-2ed2-482b-9f4c-ff4221155bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa41a9a-00db-47fd-8139-9ec815bcb8eb', 'volume_name': 'volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78af51f-fead-4180-8e42-2f5fd8392724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78af51f-fead-4180-8e42-2f5fd8392724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540701f2-bd99-4f90-a747-d042e64bd59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:20 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume 6fa41a9a-00db-47fd-8139-9ec815bcb8eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb', 'volume_size': 1}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:20 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (d8b19261-e591-4ebf-8fbb-3841c37a8855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac0ac3a-917d-4f7b-adcf-f2ce6ea9acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac0ac3a-917d-4f7b-adcf-f2ce6ea9acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589854879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7a0750-4788-4382-91d2-e7701f96726d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:20Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db59c86b-57a2-470c-958a-42be0566c90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db59c86b-57a2-470c-958a-42be0566c90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111e50ff-79bb-414d-9a78-1a47bf721377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111e50ff-79bb-414d-9a78-1a47bf721377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd7a0750-4788-4382-91d2-e7701f96726d', 'volume_name': 'volume-dd7a0750-4788-4382-91d2-e7701f96726d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ba20fb-fd7e-4cd7-abe8-047eab0c39e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ba20fb-fd7e-4cd7-abe8-047eab0c39e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88140e8-afb1-4fa5-83ab-4538eb34f291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:20 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume dd7a0750-4788-4382-91d2-e7701f96726d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd7a0750-4788-4382-91d2-e7701f96726d', 'volume_size': 1}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.722s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Deleted volume successfully.
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8262c0bf-f780-48b4-bd40-badbc390a659 tempest-VolumesServicesTestJSON-608024399 None] Lock "cinder-b36ebc13-8dad-403b-8902-c618dfe2f35e-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:20 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9" returned: 0 in 0.707s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938397550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf8d81f-c26b-42f3-955a-5f1ab587f53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:19Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Creating volume bbf8d81f-c26b-42f3-955a-5f1ab587f53e {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:20 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69cdf4a-24d2-4952-8b93-363b65fca026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116ad06f-3886-41a7-a1ec-6369e81582f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:20 devstack sudo[88194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e 1073741824
Feb 28 01:26:20 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9 (1914d2b6-b07c-4677-9467-ec1531e5bcd9): created successfully
Feb 28 01:26:20 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116ad06f-3886-41a7-a1ec-6369e81582f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (58ee83fa-eca8-4994-bdf3-bd041eede767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b07b358a-2545-420d-a389-ca4ad0b8bc71 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created volume successfully.
Feb 28 01:26:21 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e 1073741824" returned: 0 in 0.597s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:21 devstack sudo[88199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e
Feb 28 01:26:21 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:21 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e" returned: 0 in 0.490s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.967s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164132680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a50200f-f2c4-4d48-8574-ff69f9fbeb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:20Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Creating volume 9a50200f-f2c4-4d48-8574-ff69f9fbeb9c {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:21 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334f99cf-215f-4ab4-aa85-432c7f3fa987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929a6d9b-caeb-454d-a1f2-750b517f860f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:21 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c 1073741824
Feb 28 01:26:21 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:21 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e (bbf8d81f-c26b-42f3-955a-5f1ab587f53e): created successfully
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929a6d9b-caeb-454d-a1f2-750b517f860f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (8632269a-fc48-4672-a0c9-9488455beb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:21 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-aa2e9ddc-5692-4a12-ac94-24a03afd8492 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created volume successfully.
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Flow 'volume_create_manager' (6882f1ed-ebc8-483b-8f16-da2fe4dcdd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba8f585-28c5-4fde-89a6-0db6ad1f1db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba8f585-28c5-4fde-89a6-0db6ad1f1db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-536752431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910722a5-e82d-4e4b-80be-ad176c2a5a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8e8175f38e4137a7bd36700fad02bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:22Z,use_quota=True,user_id='d770f24a45384e8e8a18a53db7c6defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9987c0-5f7c-487d-a9f9-e461ae38ed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9987c0-5f7c-487d-a9f9-e461ae38ed9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfb2478-e406-4565-967d-d816c1d441a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.image.glance [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Creating Keystone auth plugin from conf {{(pid=82470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 28 01:26:22 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c 1073741824" returned: 0 in 0.565s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:22 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c
Feb 28 01:26:22 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfb2478-e406-4565-967d-d816c1d441a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '910722a5-e82d-4e4b-80be-ad176c2a5a8a', 'volume_name': 'volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc6669840>}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e367942-b846-4685-833b-99aafbee077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e367942-b846-4685-833b-99aafbee077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d03a362-1dbe-4cf1-8741-a9b90cabdbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:22 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Volume 910722a5-e82d-4e4b-80be-ad176c2a5a8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc6669840>}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Trying to clone 910722a5-e82d-4e4b-80be-ad176c2a5a8a from image 9351240e-6df5-4131-8ea1-feeaf12d9c21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]). {{(pid=82470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 28 01:26:22 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Image download 20.69 MB at 20.69 MB/s
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1c5709-cdb6-4f9d-a222-15393f8fb7c4]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:22 devstack sudo[88211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD
Feb 28 01:26:22 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:22 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c" returned: 0 in 0.492s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.654s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-51071232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa41a9a-00db-47fd-8139-9ec815bcb8eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:20Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Creating volume 6fa41a9a-00db-47fd-8139-9ec815bcb8eb {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:22 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:22 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb 1073741824
Feb 28 01:26:22 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be27bf41-ec13-4157-8cfd-87eceba4908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb2228f-64b9-4c7f-b9be-f775fda6f1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:22 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c (9a50200f-f2c4-4d48-8574-ff69f9fbeb9c): created successfully
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb2228f-64b9-4c7f-b9be-f775fda6f1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (d737975d-0087-418c-8a02-ee967f583658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:22 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-da0fd8af-cdf0-4111-8ea6-39fe7ab4ee74 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created volume successfully.
Feb 28 01:26:23 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD" returned: 0 in 0.536s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Temporary image 9351240e-6df5-4131-8ea1-feeaf12d9c21 is fetched for user d770f24a45384e8e8a18a53db7c6defd. {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9903d51e-4438-4990-8e7a-ae73e70fd563]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:23 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD
Feb 28 01:26:23 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:23 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb 1073741824" returned: 0 in 0.568s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:23 devstack sudo[88224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb
Feb 28 01:26:23 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:23 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD" returned: 0 in 0.492s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:23 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb" returned: 0 in 0.480s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.606s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589854879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7a0750-4788-4382-91d2-e7701f96726d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac5533881c54866ac1db412dd7f67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:20Z,use_quota=True,user_id='54dbe18b75154d21ba3c9ee295b01263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Creating volume dd7a0750-4788-4382-91d2-e7701f96726d {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:23 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540701f2-bd99-4f90-a747-d042e64bd59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:23 devstack sudo[88230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d 1073741824
Feb 28 01:26:23 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cf11ad-7b12-40bb-aeff-17217609bb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:23 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb (6fa41a9a-00db-47fd-8139-9ec815bcb8eb): created successfully
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cf11ad-7b12-40bb-aeff-17217609bb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (3c2581bb-3f18-437b-a336-f9a0b03780ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:23 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-f9347f25-3c68-429e-a454-e823b3f91be4 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created volume successfully.
Feb 28 01:26:24 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d 1073741824" returned: 0 in 0.519s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:24 devstack sudo[88235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d
Feb 28 01:26:24 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:24 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d" returned: 0 in 0.476s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-536752431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910722a5-e82d-4e4b-80be-ad176c2a5a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8e8175f38e4137a7bd36700fad02bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:22Z,use_quota=True,user_id='d770f24a45384e8e8a18a53db7c6defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Creating volume 910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:24 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88140e8-afb1-4fa5-83ab-4538eb34f291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd7a0750-4788-4382-91d2-e7701f96726d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:24 devstack sudo[88238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a 1073741824
Feb 28 01:26:24 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9863599-3b94-41e1-8f84-a9585e4608ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:24 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Volume volume-dd7a0750-4788-4382-91d2-e7701f96726d (dd7a0750-4788-4382-91d2-e7701f96726d): created successfully
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9863599-3b94-41e1-8f84-a9585e4608ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:24 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Flow 'volume_create_manager' (d8b19261-e591-4ebf-8fbb-3841c37a8855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:24 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8c525baf-bf89-4c0a-a81d-80c476b5a6da tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created volume successfully.
Feb 28 01:26:25 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a 1073741824" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:25 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a
Feb 28 01:26:25 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-dd7a0750-4788-4382-91d2-e7701f96726d-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-dd7a0750-4788-4382-91d2-e7701f96726d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-quobyte-dd7a0750-4788-4382-91d2-e7701f96726d" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-dd7a0750-4788-4382-91d2-e7701f96726d" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe751e69-35cf-438e-b0c2-0b25514128d9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:25 devstack sudo[88245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d
Feb 28 01:26:25 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:25 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a" returned: 0 in 0.465s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Attempting download of 9351240e-6df5-4131-8ea1-feeaf12d9c21 ((None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}])) to volume 910722a5-e82d-4e4b-80be-ad176c2a5a8a. {{(pid=82470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda1d6f0-3e5e-4bba-9625-a51c222bad10]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_9f3s7zp3 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:26 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_9f3s7zp3
Feb 28 01:26:26 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:26 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d" returned: 0 in 0.541s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:26 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d
Feb 28 01:26:26 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:26 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_9f3s7zp3" returned: 0 in 0.512s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_9f3s7zp3 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:26 devstack sudo[88257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_9f3s7zp3
Feb 28 01:26:26 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:26 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dd7a0750-4788-4382-91d2-e7701f96726d" returned: 0 in 0.471s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-dd7a0750-4788-4382-91d2-e7701f96726d" released by "delete_volume" :: held 1.043s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created reservations ['d54e7010-d410-44e0-8f78-f368a5299fb6', '25aa1acf-e1fa-4795-9921-9de3dc0f9ce8', '379b520f-97b0-4ea5-84e8-62a6be0f205d', 'bef5bcbc-c95e-4dad-9ef4-81cc493f6169'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:26 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:26 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:27 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_9f3s7zp3" returned: 1 in 0.510s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_9f3s7zp3' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd669c68-71a5-49cf-b01b-dab1dbd49842]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:27 devstack sudo[88264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD
Feb 28 01:26:27 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:27 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.445s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:27 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Deleted volume successfully.
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ebba9b0d-0519-4ff2-9c9e-b7382d20bb27 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-dd7a0750-4788-4382-91d2-e7701f96726d-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:27 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD" returned: 0 in 0.495s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] 9351240e-6df5-4131-8ea1-feeaf12d9c21 was qcow2, converting to raw {{(pid=82470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:27 devstack sudo[88270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a
Feb 28 01:26:27 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-6fa41a9a-00db-47fd-8139-9ec815bcb8eb-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-6fa41a9a-00db-47fd-8139-9ec815bcb8eb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-quobyte-6fa41a9a-00db-47fd-8139-9ec815bcb8eb" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-6fa41a9a-00db-47fd-8139-9ec815bcb8eb" acquired by "delete_volume" :: waited 0.017s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca827fc-c775-4e3b-9f7a-06030882ffd0]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:28 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb
Feb 28 01:26:28 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:28 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a" returned: 0 in 0.964s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:28 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_thv_sgk7devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:26:28 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Converted 112.00 MB image at 112.00 MB/s
Feb 28 01:26:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:28 devstack sudo[88287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a 1G
Feb 28 01:26:28 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:28 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb" returned: 0 in 0.590s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:28 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb
Feb 28 01:26:28 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:28 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a 1G" returned: 0 in 0.505s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f869fed-d6fe-4c2f-9e63-87d4ed74ae49]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:29 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fa41a9a-00db-47fd-8139-9ec815bcb8eb" returned: 0 in 0.500s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-6fa41a9a-00db-47fd-8139-9ec815bcb8eb" released by "delete_volume" :: held 1.112s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:29 devstack sudo[88298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a
Feb 28 01:26:29 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created reservations ['1aad013a-82e2-4733-a461-671b27d71031', 'cb3f7ea7-3f8c-42f6-8ffe-6a8fc0bdadf6', 'f7497804-dade-4b2f-be5f-b3d77dfcbc75', '7aab8de2-577a-431a-a5b3-2c421f2d8ac7'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:29 devstack sudo[88300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:29 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:29 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a" returned: 0 in 0.525s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:29 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.453s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:29 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Deleted volume successfully.
Feb 28 01:26:29 devstack sudo[88305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a
Feb 28 01:26:29 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:29 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d4ebda2-048b-4e92-83e0-42c215df03af tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-6fa41a9a-00db-47fd-8139-9ec815bcb8eb-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:30 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a" returned: 1 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Downloaded image 9351240e-6df5-4131-8ea1-feeaf12d9c21 ((None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}])) to volume 910722a5-e82d-4e4b-80be-ad176c2a5a8a successfully. {{(pid=82470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Temporary image 9351240e-6df5-4131-8ea1-feeaf12d9c21 for user d770f24a45384e8e8a18a53db7c6defd is deleted. {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Marking volume 910722a5-e82d-4e4b-80be-ad176c2a5a8a as bootable. {{(pid=82470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Copying metadata from image 9351240e-6df5-4131-8ea1-feeaf12d9c21 to 910722a5-e82d-4e4b-80be-ad176c2a5a8a. {{(pid=82470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Creating volume glance metadata for volume 910722a5-e82d-4e4b-80be-ad176c2a5a8a backed by image 9351240e-6df5-4131-8ea1-feeaf12d9c21 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d03a362-1dbe-4cf1-8741-a9b90cabdbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc6669840>}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56982fb3-de64-4833-a287-48afbd27c4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-quobyte-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:30 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Volume volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a (910722a5-e82d-4e4b-80be-ad176c2a5a8a): created successfully
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56982fb3-de64-4833-a287-48afbd27c4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Flow 'volume_create_manager' (6882f1ed-ebc8-483b-8f16-da2fe4dcdd64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c" acquired by "delete_volume" :: waited 0.018s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a56a076-5271-4594-a02f-5cb10f6e2a01]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:30 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5a8dfbb6-1ad2-4d44-bc74-2d68b99df50e tempest-VolumesExtendTest-1223467285 None] Created volume successfully.
Feb 28 01:26:30 devstack sudo[88310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c
Feb 28 01:26:30 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[953c9ee0-ec2e-4887-bcbd-5f64daa4b497]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:30 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a
Feb 28 01:26:30 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:30 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c" returned: 0 in 0.659s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:30 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c
Feb 28 01:26:30 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:31 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a" returned: 0 in 0.663s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:31 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c" returned: 0 in 0.464s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c" released by "delete_volume" :: held 1.148s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created reservations ['1c18120f-9761-4b76-9dc4-76e762e51812', '954e1489-6430-45c0-ae8d-be6453e3b37c', '0f3228cf-a3c2-484a-a204-d428c97aa115', '42d8e6ce-6a24-4235-934b-e37f7d072005'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:31 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a
Feb 28 01:26:31 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:31 devstack sudo[88325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:31 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:31 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a" returned: 1 in 0.568s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a 2G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:31 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.474s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:31 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Deleted volume successfully.
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7e3fb348-c194-43c3-866b-903be51a6d92 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-9a50200f-f2c4-4d48-8574-ff69f9fbeb9c-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a 2G" returned: 0 in 0.048s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.338s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:31 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-77ab37c2-f2d5-462e-9985-87b51b4499cc tempest-VolumesExtendTest-1223467285 None] Extend volume completed successfully.
Feb 28 01:26:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-bbf8d81f-c26b-42f3-955a-5f1ab587f53e-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-bbf8d81f-c26b-42f3-955a-5f1ab587f53e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-quobyte-bbf8d81f-c26b-42f3-955a-5f1ab587f53e" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-bbf8d81f-c26b-42f3-955a-5f1ab587f53e" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:32 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3852a704-f82b-40f9-a342-63647fd1a583]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:32 devstack sudo[88335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e
Feb 28 01:26:32 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:32 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e" returned: 0 in 0.545s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:32 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e
Feb 28 01:26:32 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Acquiring lock "cinder-910722a5-e82d-4e4b-80be-ad176c2a5a8a-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Lock "cinder-910722a5-e82d-4e4b-80be-ad176c2a5a8a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Acquiring lock "cinder-quobyte-910722a5-e82d-4e4b-80be-ad176c2a5a8a" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Lock "cinder-quobyte-910722a5-e82d-4e4b-80be-ad176c2a5a8a" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f505cefa-972d-4dcf-85a3-9f3acee95b79]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:33 devstack sudo[88342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a
Feb 28 01:26:33 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:33 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-bbf8d81f-c26b-42f3-955a-5f1ab587f53e" returned: 0 in 0.460s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-bbf8d81f-c26b-42f3-955a-5f1ab587f53e" released by "delete_volume" :: held 1.037s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created reservations ['e4eb93c8-c4b1-400f-aaae-6f9398150627', '5bc8a99f-3eab-4c3c-ae3b-4b143de27cc4', '5cc36708-7eeb-4bbd-8fa8-9859edc1b511', 'fb1d99b0-aa79-4ef5-a9fc-afda94c4ccd8'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:33 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:33 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:33 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a" returned: 0 in 0.516s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:33 devstack sudo[88349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a
Feb 28 01:26:33 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:33 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.439s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:33 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Deleted volume successfully.
Feb 28 01:26:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c4159800-8772-46bb-b5ec-65ced569c189 tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-bbf8d81f-c26b-42f3-955a-5f1ab587f53e-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:34 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a" returned: 1 in 0.532s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:34 devstack sudo[88355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a
Feb 28 01:26:34 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-1914d2b6-b07c-4677-9467-ec1531e5bcd9-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-1914d2b6-b07c-4677-9467-ec1531e5bcd9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-quobyte-1914d2b6-b07c-4677-9467-ec1531e5bcd9" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-1914d2b6-b07c-4677-9467-ec1531e5bcd9" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2681767a-50d5-46e9-9aac-03843e04dae9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:34 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-910722a5-e82d-4e4b-80be-ad176c2a5a8a" returned: 0 in 0.433s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Lock "cinder-quobyte-910722a5-e82d-4e4b-80be-ad176c2a5a8a" released by "delete_volume" :: held 1.525s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Created reservations ['ee6b3f3d-9eb4-443c-bfe7-65444f28907d', '8454251d-88cd-44de-9ccc-09a3c1d1bed3', '4d40d021-72df-4280-902e-aca977d38eab', 'a59cfc57-9f9b-470a-8260-f042198cccc1'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:34 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9
Feb 28 01:26:34 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:34 devstack sudo[88360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:34 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:35 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.428s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:35 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:35 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Deleted volume successfully.
Feb 28 01:26:35 devstack sudo[88366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9
Feb 28 01:26:35 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e39044c7-6af0-420e-88db-1073198c3f9c tempest-VolumesExtendTest-1223467285 None] Lock "cinder-910722a5-e82d-4e4b-80be-ad176c2a5a8a-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Flow 'volume_create_manager' (2e22ec34-02d4-4b21-82d8-6c0751a39238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3aa5ce4-82e5-43aa-9adb-fb444824a8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3aa5ce4-82e5-43aa-9adb-fb444824a8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-934475966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6ae216-33df-4e7c-b5f9-5c0b13eba335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8e8175f38e4137a7bd36700fad02bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:35Z,use_quota=True,user_id='d770f24a45384e8e8a18a53db7c6defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75997400-977b-4b0c-bc9c-0ddf8dfb2830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75997400-977b-4b0c-bc9c-0ddf8dfb2830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960fb421-8793-4c7a-9560-60d0d5ef45de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960fb421-8793-4c7a-9560-60d0d5ef45de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc6ae216-33df-4e7c-b5f9-5c0b13eba335', 'volume_name': 'volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892007ef-43ba-4ce8-8169-b12d42596897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892007ef-43ba-4ce8-8169-b12d42596897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c00a4ff-1797-4d19-91c3-8ca6ffb07578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:35 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Volume cc6ae216-33df-4e7c-b5f9-5c0b13eba335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335', 'volume_size': 1}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:35 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-934475966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6ae216-33df-4e7c-b5f9-5c0b13eba335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8e8175f38e4137a7bd36700fad02bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:35Z,use_quota=True,user_id='d770f24a45384e8e8a18a53db7c6defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Creating volume cc6ae216-33df-4e7c-b5f9-5c0b13eba335 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:35 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1914d2b6-b07c-4677-9467-ec1531e5bcd9" returned: 0 in 0.543s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:35 devstack sudo[88369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 1073741824
Feb 28 01:26:35 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-1914d2b6-b07c-4677-9467-ec1531e5bcd9" released by "delete_volume" :: held 1.091s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created reservations ['bde9c635-e86f-4938-9761-fdd08cccaee9', '518ff16f-a339-4359-9777-6cd98052ecce', '7b78c057-b5d9-4eb2-bc29-13fba34960ea', '6b8da49c-e95f-4156-a621-1d06ab30f0d9'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:35 devstack sudo[88371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:35 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:36 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 1073741824" returned: 0 in 0.508s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:36 devstack sudo[88377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335
Feb 28 01:26:36 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:36 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.503s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:36 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Deleted volume successfully.
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-77bd4d55-3890-4148-acf5-0a64c60e9f9e tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-1914d2b6-b07c-4677-9467-ec1531e5bcd9-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:36 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" returned: 0 in 0.510s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c00a4ff-1797-4d19-91c3-8ca6ffb07578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d445593-95fd-437c-ad00-ecb56804afbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-e43a1943-14a6-4eda-9755-8e843a9b13d7-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:36 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Volume volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 (cc6ae216-33df-4e7c-b5f9-5c0b13eba335): created successfully
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d445593-95fd-437c-ad00-ecb56804afbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Flow 'volume_create_manager' (2e22ec34-02d4-4b21-82d8-6c0751a39238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-e43a1943-14a6-4eda-9755-8e843a9b13d7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:36 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c949a159-ad42-4f74-a1f9-f187ac71e0e3 tempest-VolumesExtendTest-1223467285 None] Created volume successfully.
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "cinder-quobyte-e43a1943-14a6-4eda-9755-8e843a9b13d7" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-e43a1943-14a6-4eda-9755-8e843a9b13d7" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c6523d-e84e-4d95-8cfa-1750e1afdbec]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:36 devstack sudo[88380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7
Feb 28 01:26:36 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:37 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7" returned: 0 in 0.495s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:37 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7
Feb 28 01:26:37 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:37 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e43a1943-14a6-4eda-9755-8e843a9b13d7" returned: 0 in 0.412s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-quobyte-e43a1943-14a6-4eda-9755-8e843a9b13d7" released by "delete_volume" :: held 0.928s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=238,cinder:UPDATE=303,cinder:INSERT=88,cinder:DELETE=27 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Created reservations ['91b3e15e-946a-4a29-805d-90c942ee2dd5', 'f5b5c701-69aa-4ef8-812c-6ded05b50b91', '16ca896e-3863-413c-acc0-f50fd933eafb', 'd16d4a8a-5ea6-484c-8f0c-1e96a8c15933'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:37 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:37 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Creating offline snapshot 3c1a33ca-921f-4cff-adc4-d8246c9b7555 of volume cc6ae216-33df-4e7c-b5f9-5c0b13eba335 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3309416a-b462-4fd5-91c5-6df499565e7d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:37 devstack sudo[88390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335
Feb 28 01:26:37 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:38 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.512s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:38 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:38 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Deleted volume successfully.
Feb 28 01:26:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2bcb02c-c6ca-474c-8316-850ab7b5a4fc tempest-CreateVolumesFromSourceVolumeTest-568638734 None] Lock "cinder-e43a1943-14a6-4eda-9755-8e843a9b13d7-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:38 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" returned: 0 in 0.780s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:38 devstack sudo[88396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 1G
Feb 28 01:26:38 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:39 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 1G" returned: 0 in 0.606s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:39 devstack sudo[88435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555
Feb 28 01:26:39 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:39 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555" returned: 0 in 0.443s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:39 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 is being set with open permissions: ugo+rw
Feb 28 01:26:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:39 devstack sudo[88440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555
Feb 28 01:26:39 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:40 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555" returned: 0 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:40 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.info
Feb 28 01:26:40 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:40 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.info" returned: 0 in 0.404s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:40 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.info is being set with open permissions: ugo+rw
Feb 28 01:26:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:40 devstack sudo[88454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.info
Feb 28 01:26:40 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:40 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.info" returned: 0 in 0.436s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.174s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:40 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7f995705-4a4d-476e-a02d-80d906fce704 tempest-VolumesExtendTest-1223467285 None] Create snapshot completed successfully
Feb 28 01:26:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5f8c412d-8dd9-4a43-b028-d0ea60baa20f tempest-VolumesExtendTest-1223467285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5f8c412d-8dd9-4a43-b028-d0ea60baa20f tempest-VolumesExtendTest-1223467285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:41 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e4ba37-c8a6-4fc9-9ece-4001ad9c750f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5f8c412d-8dd9-4a43-b028-d0ea60baa20f tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:42 devstack sudo[88458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335
Feb 28 01:26:42 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:42 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5f8c412d-8dd9-4a43-b028-d0ea60baa20f tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" returned: 0 in 0.495s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5f8c412d-8dd9-4a43-b028-d0ea60baa20f tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 2G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5f8c412d-8dd9-4a43-b028-d0ea60baa20f tempest-VolumesExtendTest-1223467285 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 2G" returned: 0 in 0.071s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5f8c412d-8dd9-4a43-b028-d0ea60baa20f tempest-VolumesExtendTest-1223467285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.584s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:42 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=211,cinder:DELETE=24,cinder:UPDATE=307,cinder:INSERT=74 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:26:42 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5f8c412d-8dd9-4a43-b028-d0ea60baa20f tempest-VolumesExtendTest-1223467285 None] Extend volume completed successfully.
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Acquiring lock "cinder-3c1a33ca-921f-4cff-adc4-d8246c9b7555-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Lock "cinder-3c1a33ca-921f-4cff-adc4-d8246c9b7555-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Acquiring lock "cinder-quobyte-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Lock "cinder-quobyte-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Acquiring lock "cinder-quobyte-3c1a33ca-921f-4cff-adc4-d8246c9b7555" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Lock "cinder-quobyte-3c1a33ca-921f-4cff-adc4-d8246c9b7555" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Deleting offline snapshot 3c1a33ca-921f-4cff-adc4-d8246c9b7555 of volume cc6ae216-33df-4e7c-b5f9-5c0b13eba335 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] snapshot_file for this snap is: volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f6ec09-af75-4058-88a4-611806e152b9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:43 devstack sudo[88466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555
Feb 28 01:26:43 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:43 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555" returned: 0 in 0.513s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e337e7ca-0070-4529-b277-df3d7c056a00]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:43 devstack sudo[88471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335
Feb 28 01:26:43 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:44 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" returned: 0 in 0.539s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:44 devstack sudo[88476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555
Feb 28 01:26:44 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:44 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555" returned: 0 in 0.514s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:44 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555
Feb 28 01:26:44 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:45 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335.3c1a33ca-921f-4cff-adc4-d8246c9b7555" returned: 0 in 0.403s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Lock "cinder-quobyte-3c1a33ca-921f-4cff-adc4-d8246c9b7555" released by "_delete_snapshot" :: held 2.026s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Lock "cinder-quobyte-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" released by "delete_snapshot" :: held 2.039s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:45 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Created reservations ['c3d95d75-6bb6-46c7-8e17-f1792342b0ba', '0003655f-249e-4196-9703-5f1a91cff356', 'bb53c30e-890d-4b69-9f3d-1a5d16b9c378', '78be1806-bc54-4901-8c4c-62bd3b2220aa'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:45 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Delete snapshot completed successfully.
Feb 28 01:26:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a2cf4994-9fdc-466b-a6a6-c7b3405ac598 tempest-VolumesExtendTest-1223467285 None] Lock "cinder-3c1a33ca-921f-4cff-adc4-d8246c9b7555-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Acquiring lock "cinder-cc6ae216-33df-4e7c-b5f9-5c0b13eba335-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Lock "cinder-cc6ae216-33df-4e7c-b5f9-5c0b13eba335-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Acquiring lock "cinder-quobyte-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:46 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Lock "cinder-quobyte-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" acquired by "delete_volume" :: waited 0.017s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:46 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db00f26-d287-415d-a64c-100777986a63]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:46 devstack sudo[88485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335
Feb 28 01:26:46 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:46 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" returned: 0 in 0.537s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:46 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335
Feb 28 01:26:46 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:47 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" returned: 0 in 0.411s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Lock "cinder-quobyte-cc6ae216-33df-4e7c-b5f9-5c0b13eba335" released by "delete_volume" :: held 0.984s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Created reservations ['6e6a396b-8c99-47c8-b04e-8688a8411ead', 'fa11e5f8-02b7-485d-9607-7dc722c4e0fc', 'd8199fe5-549c-4b84-9037-53366ec5ddb7', '07f58b4e-5b2f-4ffd-8e12-3f647feda10c'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:47 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:47 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:47 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.400s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:47 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Deleted volume successfully.
Feb 28 01:26:47 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7a51a718-3d95-48b6-962d-707d788ef3a8 tempest-VolumesExtendTest-1223467285 None] Lock "cinder-cc6ae216-33df-4e7c-b5f9-5c0b13eba335-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Flow 'volume_create_manager' (cdd81687-bc86-4186-9067-7a62007453e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f34f91-c5dd-4ca2-aabc-460f9b826569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f34f91-c5dd-4ca2-aabc-460f9b826569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1349233067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d572619-f509-4114-9733-76fe9d0725f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c414a6d5cfc14442a2e379159e344133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:50Z,use_quota=True,user_id='df0448fe491145b8999e8a2843c892d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87dbc890-6c14-4524-9538-5d6a91cd721a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87dbc890-6c14-4524-9538-5d6a91cd721a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a13a40-c964-4588-8e76-8204333d0519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a13a40-c964-4588-8e76-8204333d0519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d572619-f509-4114-9733-76fe9d0725f2', 'volume_name': 'volume-8d572619-f509-4114-9733-76fe9d0725f2', 'volume_size': 2}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9b25f6-1065-444c-9593-311b10614a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9b25f6-1065-444c-9593-311b10614a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6af669-efff-432e-b59a-6fb94f6b233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:50 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Volume 8d572619-f509-4114-9733-76fe9d0725f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d572619-f509-4114-9733-76fe9d0725f2', 'volume_size': 2}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1349233067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d572619-f509-4114-9733-76fe9d0725f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c414a6d5cfc14442a2e379159e344133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:26:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:26:50Z,use_quota=True,user_id='df0448fe491145b8999e8a2843c892d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Creating volume 8d572619-f509-4114-9733-76fe9d0725f2 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:26:50 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2 2147483648 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:50 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2 2147483648
Feb 28 01:26:50 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:50 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2 2147483648" returned: 0 in 0.474s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:50 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2
Feb 28 01:26:50 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:51 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2" returned: 0 in 0.412s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:26:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6af669-efff-432e-b59a-6fb94f6b233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d572619-f509-4114-9733-76fe9d0725f2', 'volume_size': 2}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f1dcbe-cfda-43fb-89e4-d9016500dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:51 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Volume volume-8d572619-f509-4114-9733-76fe9d0725f2 (8d572619-f509-4114-9733-76fe9d0725f2): created successfully
Feb 28 01:26:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f1dcbe-cfda-43fb-89e4-d9016500dae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Flow 'volume_create_manager' (cdd81687-bc86-4186-9067-7a62007453e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:51 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ff96ad09-37f6-4359-9740-0069ecb778ff tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Created volume successfully.
Feb 28 01:26:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Creating offline snapshot 151b1fa7-025e-437f-9570-280c075b2c51 of volume 8d572619-f509-4114-9733-76fe9d0725f2 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:26:52 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b610f2-2426-4b96-95d6-7dfc72ec61f9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:52 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2
Feb 28 01:26:52 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:52 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2" returned: 0 in 0.511s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51 2G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:53 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51 2G
Feb 28 01:26:53 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:53 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51 2G" returned: 0 in 0.462s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d572619-f509-4114-9733-76fe9d0725f2 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:53 devstack sudo[88532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d572619-f509-4114-9733-76fe9d0725f2 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51
Feb 28 01:26:53 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:53 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d572619-f509-4114-9733-76fe9d0725f2 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51" returned: 0 in 0.452s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:53 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51 is being set with open permissions: ugo+rw
Feb 28 01:26:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:53 devstack sudo[88539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51
Feb 28 01:26:53 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:54 devstack sudo[88542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:54 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:54 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51" returned: 0 in 0.396s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:54 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.info
Feb 28 01:26:54 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:54 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.411s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:54 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.info" returned: 0 in 0.445s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:54 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.info is being set with open permissions: ugo+rw
Feb 28 01:26:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:54 devstack sudo[88548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.info
Feb 28 01:26:54 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:55 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.info" returned: 0 in 0.406s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.736s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:55 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-6174f6f1-6f01-438d-83ca-97b8fb867134 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Create snapshot completed successfully
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Acquiring lock "cinder-151b1fa7-025e-437f-9570-280c075b2c51-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "cinder-151b1fa7-025e-437f-9570-280c075b2c51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Acquiring lock "cinder-quobyte-8d572619-f509-4114-9733-76fe9d0725f2" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "cinder-quobyte-8d572619-f509-4114-9733-76fe9d0725f2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Acquiring lock "cinder-quobyte-151b1fa7-025e-437f-9570-280c075b2c51" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "cinder-quobyte-151b1fa7-025e-437f-9570-280c075b2c51" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Deleting offline snapshot 151b1fa7-025e-437f-9570-280c075b2c51 of volume 8d572619-f509-4114-9733-76fe9d0725f2 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] snapshot_file for this snap is: volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[028de916-15e1-499b-9cb8-cd43e1a83f31]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:55 devstack sudo[88551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51
Feb 28 01:26:55 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:56 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51" returned: 0 in 0.486s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d572619-f509-4114-9733-76fe9d0725f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:26:56 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2063c0-8f8a-4c8e-9da1-919b5088ade3]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:56 devstack sudo[88559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2
Feb 28 01:26:56 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:56 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2" returned: 0 in 0.467s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:56 devstack sudo[88566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51
Feb 28 01:26:56 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:57 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51" returned: 0 in 0.458s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:57 devstack sudo[88571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51
Feb 28 01:26:57 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:57 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2.151b1fa7-025e-437f-9570-280c075b2c51" returned: 0 in 0.494s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "cinder-quobyte-151b1fa7-025e-437f-9570-280c075b2c51" released by "_delete_snapshot" :: held 1.979s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "cinder-quobyte-8d572619-f509-4114-9733-76fe9d0725f2" released by "delete_snapshot" :: held 1.996s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Created reservations ['3b31b54b-44b7-4e5f-b3ba-5be33dd90a9f', 'e2c1aa1e-86bd-4e70-89c5-34b2e2f7ce06', '7b958394-9181-4cdf-a207-25f618017489', 'd1aff93a-d7ee-4026-bdaf-a430494e7bc2'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:57 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Delete snapshot completed successfully.
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-08b04a6f-236b-4ee5-b866-5db56f294d41 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "cinder-151b1fa7-025e-437f-9570-280c075b2c51-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Acquiring lock "cinder-8d572619-f509-4114-9733-76fe9d0725f2-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "cinder-8d572619-f509-4114-9733-76fe9d0725f2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Acquiring lock "cinder-quobyte-8d572619-f509-4114-9733-76fe9d0725f2" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "cinder-quobyte-8d572619-f509-4114-9733-76fe9d0725f2" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a3c48e-2c55-4124-a490-2f9c3d148c09]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:26:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:58 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2
Feb 28 01:26:58 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:58 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2" returned: 0 in 0.529s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:58 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2
Feb 28 01:26:58 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:58 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8d572619-f509-4114-9733-76fe9d0725f2" returned: 0 in 0.427s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "cinder-quobyte-8d572619-f509-4114-9733-76fe9d0725f2" released by "delete_volume" :: held 0.997s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Created reservations ['9de77f33-3a86-449a-90ae-976609563a58', '5b4062eb-5db0-457c-9c61-cb702c359b2f', '53eaf33c-7f3d-43d2-86da-c945b43100ec', '9db8ce7f-b240-4df0-a0d6-e3bad66e1507'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:26:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:26:59 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:26:59 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:26:59 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.429s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:26:59 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Deleted volume successfully.
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f1b1382e-d804-45bb-bc04-b35a39e39de2 tempest-VolumesSnapshotNegativeTestJSON-1903766756 None] Lock "cinder-8d572619-f509-4114-9733-76fe9d0725f2-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (ffa3bdb9-d161-4cb8-a7b1-7cbbe2b72810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88370f35-0da3-4402-84e3-5078cd4ba852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88370f35-0da3-4402-84e3-5078cd4ba852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1152102090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d068bd-24a5-455c-a5af-eef7f39d36e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:00Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc2f1df-cd19-4b46-892d-f0f421c1862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc2f1df-cd19-4b46-892d-f0f421c1862d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc5d4fd-98eb-4ced-be21-f6f203daff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc5d4fd-98eb-4ced-be21-f6f203daff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d068bd-24a5-455c-a5af-eef7f39d36e1', 'volume_name': 'volume-66d068bd-24a5-455c-a5af-eef7f39d36e1', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4491b8-70bd-4f7b-8ce5-9522b8185cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4491b8-70bd-4f7b-8ce5-9522b8185cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a38395-ef00-430a-89e1-4136702ca459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:26:59 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Volume 66d068bd-24a5-455c-a5af-eef7f39d36e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d068bd-24a5-455c-a5af-eef7f39d36e1', 'volume_size': 1}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1152102090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d068bd-24a5-455c-a5af-eef7f39d36e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:00Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Creating volume 66d068bd-24a5-455c-a5af-eef7f39d36e1 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:26:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:00 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:00 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1 1073741824
Feb 28 01:27:00 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:00 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1 1073741824" returned: 0 in 0.558s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:00 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1
Feb 28 01:27:00 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:01 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1" returned: 0 in 0.522s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a38395-ef00-430a-89e1-4136702ca459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d068bd-24a5-455c-a5af-eef7f39d36e1', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1033e688-7443-4260-9914-1326fc06db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:01 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Volume volume-66d068bd-24a5-455c-a5af-eef7f39d36e1 (66d068bd-24a5-455c-a5af-eef7f39d36e1): created successfully
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1033e688-7443-4260-9914-1326fc06db09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (ffa3bdb9-d161-4cb8-a7b1-7cbbe2b72810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:01 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3c8ace71-fa52-4d45-9800-408ae9df318a tempest-VolumesActionsTest-2139482103 None] Created volume successfully.
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Flow 'volume_create_manager' (dbd6c6d9-c5f3-4bd6-bb72-cd8d49e5b419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4969a8c-9ca3-49a4-9ea9-887f6f5151c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4969a8c-9ca3-49a4-9ea9-887f6f5151c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d9ac8a-c16c-465a-8a2a-bdd6e81140ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab20f89f3c843318391faadd4c84ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:02Z,use_quota=True,user_id='04e7e0316e894febb27e39a000debf80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b24126-491f-42e2-8543-07838d1bc041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b24126-491f-42e2-8543-07838d1bc041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710a57d9-fdfd-484e-b8e5-73af901a4fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710a57d9-fdfd-484e-b8e5-73af901a4fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d9ac8a-c16c-465a-8a2a-bdd6e81140ff', 'volume_name': 'volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3022d9db-665a-49ef-8d1a-30ece9dc4adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3022d9db-665a-49ef-8d1a-30ece9dc4adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a0a415-cfd2-4001-a871-d8f3ca91e489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:01 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Volume 05d9ac8a-c16c-465a-8a2a-bdd6e81140ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff', 'volume_size': 1}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d9ac8a-c16c-465a-8a2a-bdd6e81140ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab20f89f3c843318391faadd4c84ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:02Z,use_quota=True,user_id='04e7e0316e894febb27e39a000debf80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Creating volume 05d9ac8a-c16c-465a-8a2a-bdd6e81140ff {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:01 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:01 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff 1073741824
Feb 28 01:27:01 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-051f5c26-1c74-46ed-96db-7475d73b6678 tempest-VolumesActionsTest-2139482103 None] Acquiring lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1" by "attach_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-051f5c26-1c74-46ed-96db-7475d73b6678 tempest-VolumesActionsTest-2139482103 None] Lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1" acquired by "attach_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:02 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-051f5c26-1c74-46ed-96db-7475d73b6678 tempest-VolumesActionsTest-2139482103 None] Attaching volume 66d068bd-24a5-455c-a5af-eef7f39d36e1 to instance 255861de-acb5-468d-a618-d48053865afe at mountpoint /dev/vdb on host None.
Feb 28 01:27:02 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-051f5c26-1c74-46ed-96db-7475d73b6678 tempest-VolumesActionsTest-2139482103 None] Attach volume completed successfully.
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-051f5c26-1c74-46ed-96db-7475d73b6678 tempest-VolumesActionsTest-2139482103 None] Lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1" released by "attach_volume" :: held 0.099s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:02 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff 1073741824" returned: 0 in 0.467s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:02 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff
Feb 28 01:27:02 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:02 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff" returned: 0 in 0.403s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a0a415-cfd2-4001-a871-d8f3ca91e489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deec0aaa-01f9-4e7b-98c7-1944ebb48ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:02 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Volume volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff (05d9ac8a-c16c-465a-8a2a-bdd6e81140ff): created successfully
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deec0aaa-01f9-4e7b-98c7-1944ebb48ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Flow 'volume_create_manager' (dbd6c6d9-c5f3-4bd6-bb72-cd8d49e5b419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:02 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-31c2aba1-18a5-451e-ac2c-00ae103eb0cc tempest-CinderUnicodeTest-299469770 None] Created volume successfully.
Feb 28 01:27:02 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c37a2a88-caca-421f-96f4-04ffacb2a0b9 tempest-VolumesActionsTest-1480922504 None] Terminate volume connection completed successfully.
Feb 28 01:27:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c37a2a88-caca-421f-96f4-04ffacb2a0b9 tempest-VolumesActionsTest-1480922504 None] Acquiring lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1-detach_volume" by "detach_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c37a2a88-caca-421f-96f4-04ffacb2a0b9 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:03 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c37a2a88-caca-421f-96f4-04ffacb2a0b9 tempest-VolumesActionsTest-1480922504 None] Detaching volume 66d068bd-24a5-455c-a5af-eef7f39d36e1 from instance 255861de-acb5-468d-a618-d48053865afe.
Feb 28 01:27:03 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c37a2a88-caca-421f-96f4-04ffacb2a0b9 tempest-VolumesActionsTest-1480922504 None] Detach volume completed successfully.
Feb 28 01:27:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c37a2a88-caca-421f-96f4-04ffacb2a0b9 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-46b3f6d3-afbd-44c9-8ef7-267ebbe839b1 tempest-VolumesActionsTest-2139482103 None] Acquiring lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1-detach_volume" by "detach_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-46b3f6d3-afbd-44c9-8ef7-267ebbe839b1 tempest-VolumesActionsTest-2139482103 None] Lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:04 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-46b3f6d3-afbd-44c9-8ef7-267ebbe839b1 tempest-VolumesActionsTest-2139482103 None] Volume detach called, but volume not attached.
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Flow 'volume_create_manager' (c0364255-e7d6-4b8b-9b0c-ee451983c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cf989d-4330-4b6a-abee-b4e8ae3dcbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cf989d-4330-4b6a-abee-b4e8ae3dcbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-836798714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2b0b73-0568-4960-b281-b0983922716a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab20f89f3c843318391faadd4c84ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:04Z,use_quota=True,user_id='04e7e0316e894febb27e39a000debf80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a60dc80-78da-44d5-8151-ad95f427c47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a60dc80-78da-44d5-8151-ad95f427c47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e834ca85-8cfb-43d9-a0d1-ed406b7242ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e834ca85-8cfb-43d9-a0d1-ed406b7242ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2b0b73-0568-4960-b281-b0983922716a', 'volume_name': 'volume-9d2b0b73-0568-4960-b281-b0983922716a', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37178af0-af2f-4ca0-8b0b-7a70d18af038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37178af0-af2f-4ca0-8b0b-7a70d18af038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6614308-7095-4f5a-be47-4f5e08d57f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:04 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Volume 9d2b0b73-0568-4960-b281-b0983922716a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2b0b73-0568-4960-b281-b0983922716a', 'volume_size': 1}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-836798714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2b0b73-0568-4960-b281-b0983922716a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab20f89f3c843318391faadd4c84ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:04Z,use_quota=True,user_id='04e7e0316e894febb27e39a000debf80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Creating volume 9d2b0b73-0568-4960-b281-b0983922716a {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:04 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-46b3f6d3-afbd-44c9-8ef7-267ebbe839b1 tempest-VolumesActionsTest-2139482103 None] Lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:04 devstack sudo[88629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a 1073741824
Feb 28 01:27:04 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:04 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a 1073741824" returned: 0 in 0.460s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:04 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a
Feb 28 01:27:04 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Acquiring lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Acquiring lock "cinder-quobyte-66d068bd-24a5-455c-a5af-eef7f39d36e1" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Lock "cinder-quobyte-66d068bd-24a5-455c-a5af-eef7f39d36e1" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[237f1279-52e3-4107-81fd-346fe0086117]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:04 devstack sudo[88636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1
Feb 28 01:27:04 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:05 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a" returned: 0 in 0.390s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6614308-7095-4f5a-be47-4f5e08d57f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2b0b73-0568-4960-b281-b0983922716a', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36504b09-46dc-40b5-9e2e-de82df6abd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:05 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Volume volume-9d2b0b73-0568-4960-b281-b0983922716a (9d2b0b73-0568-4960-b281-b0983922716a): created successfully
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36504b09-46dc-40b5-9e2e-de82df6abd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Flow 'volume_create_manager' (c0364255-e7d6-4b8b-9b0c-ee451983c11c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:05 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-df8afd92-6299-42cc-aae6-739e4f8ab6b7 tempest-CinderUnicodeTest-299469770 None] Created volume successfully.
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Creating offline snapshot 58fb8689-2500-47fb-9e0c-040991d59753 of volume 9d2b0b73-0568-4960-b281-b0983922716a {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3999d2ef-2e58-4dc2-9ca9-f27f1f82bb67]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:05 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1" returned: 0 in 0.563s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:05 devstack sudo[88643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1
Feb 28 01:27:05 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:05 devstack sudo[88642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a
Feb 28 01:27:05 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:05 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-66d068bd-24a5-455c-a5af-eef7f39d36e1" returned: 0 in 0.402s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Lock "cinder-quobyte-66d068bd-24a5-455c-a5af-eef7f39d36e1" released by "delete_volume" :: held 0.989s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:05 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a" returned: 0 in 0.489s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Created reservations ['7bcb30c6-4f75-4a32-9558-4171a206cff6', 'd180eb96-90d4-4221-847f-38c7d8b41e34', '82bdea32-a91a-4c3d-abf0-022f8356aa84', '18e73a6d-6618-4836-a80c-c92e6e22dd3d'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:05 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753 1G
Feb 28 01:27:05 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:05 devstack sudo[88652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:05 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:06 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753 1G" returned: 0 in 0.499s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2b0b73-0568-4960-b281-b0983922716a -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:06 devstack sudo[88658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2b0b73-0568-4960-b281-b0983922716a -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753
Feb 28 01:27:06 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:06 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.522s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:06 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:06 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Deleted volume successfully.
Feb 28 01:27:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b3b7effb-10e6-4315-a5d4-da54eb752e2f tempest-VolumesActionsTest-2139482103 None] Lock "cinder-66d068bd-24a5-455c-a5af-eef7f39d36e1-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:06 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2b0b73-0568-4960-b281-b0983922716a -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753" returned: 0 in 0.423s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:06 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753 is being set with open permissions: ugo+rw
Feb 28 01:27:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:06 devstack sudo[88663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753
Feb 28 01:27:06 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:07 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753" returned: 0 in 0.415s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:07 devstack sudo[88675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.info
Feb 28 01:27:07 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:07 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.info" returned: 0 in 0.483s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:07 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.info is being set with open permissions: ugo+rw
Feb 28 01:27:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:07 devstack sudo[88695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.info
Feb 28 01:27:07 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:08 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.info" returned: 0 in 0.401s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:08 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ec9302ca-8453-4e33-a399-b9aa66bedeb4 tempest-CinderUnicodeTest-299469770 None] Create snapshot completed successfully
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Acquiring lock "cinder-58fb8689-2500-47fb-9e0c-040991d59753-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Lock "cinder-58fb8689-2500-47fb-9e0c-040991d59753-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Acquiring lock "cinder-quobyte-9d2b0b73-0568-4960-b281-b0983922716a" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Lock "cinder-quobyte-9d2b0b73-0568-4960-b281-b0983922716a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Acquiring lock "cinder-quobyte-58fb8689-2500-47fb-9e0c-040991d59753" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Lock "cinder-quobyte-58fb8689-2500-47fb-9e0c-040991d59753" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Deleting offline snapshot 58fb8689-2500-47fb-9e0c-040991d59753 of volume 9d2b0b73-0568-4960-b281-b0983922716a {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] snapshot_file for this snap is: volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5509bb6b-be3f-418c-970f-84b8f5189056]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:08 devstack sudo[88699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753
Feb 28 01:27:08 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:09 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753" returned: 0 in 0.498s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2b0b73-0568-4960-b281-b0983922716a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:27:09 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[40239ca4-8cb0-4987-975d-89d66a03be46]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:09 devstack sudo[88705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a
Feb 28 01:27:09 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:09 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a" returned: 0 in 0.451s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:09 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753
Feb 28 01:27:09 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:09 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753" returned: 0 in 0.468s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:09 devstack sudo[88715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753
Feb 28 01:27:09 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:10 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a.58fb8689-2500-47fb-9e0c-040991d59753" returned: 0 in 0.398s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Lock "cinder-quobyte-58fb8689-2500-47fb-9e0c-040991d59753" released by "_delete_snapshot" :: held 1.872s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Lock "cinder-quobyte-9d2b0b73-0568-4960-b281-b0983922716a" released by "delete_snapshot" :: held 1.883s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Created reservations ['002471f4-0b31-44e0-867e-82ed81f15871', 'd5e7a096-7ccf-425f-ade5-c4b3aa3679d1', '39baa502-2ca1-4e09-8273-3b02f5383f5a', 'ad14287d-c73c-4d01-9f34-6e15d2c3027b'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:10 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Delete snapshot completed successfully.
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5fd7c6c4-ebf6-4318-a183-9b0fe004b146 tempest-CinderUnicodeTest-299469770 None] Lock "cinder-58fb8689-2500-47fb-9e0c-040991d59753-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Acquiring lock "cinder-9d2b0b73-0568-4960-b281-b0983922716a-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Lock "cinder-9d2b0b73-0568-4960-b281-b0983922716a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Acquiring lock "cinder-quobyte-9d2b0b73-0568-4960-b281-b0983922716a" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Lock "cinder-quobyte-9d2b0b73-0568-4960-b281-b0983922716a" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d283c03b-9a1f-4ee8-bc61-5cdd9682445c]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:10 devstack sudo[88718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a
Feb 28 01:27:10 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:11 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a" returned: 0 in 0.452s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:11 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a
Feb 28 01:27:11 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:11 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-9d2b0b73-0568-4960-b281-b0983922716a" returned: 0 in 0.400s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Lock "cinder-quobyte-9d2b0b73-0568-4960-b281-b0983922716a" released by "delete_volume" :: held 0.886s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Created reservations ['66ca508c-5d36-4302-b73f-4e01d8625b29', '5dfd9f2c-55af-4c08-ae8d-d0e7b8b126d7', 'e0abf2af-0ebd-45e1-af3e-0e35b0b9a77c', '584c4027-5ebd-4c20-b3b5-3ab903dc1077'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:11 devstack sudo[88726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:11 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Acquiring lock "cinder-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Lock "cinder-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Acquiring lock "cinder-quobyte-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Lock "cinder-quobyte-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff" acquired by "delete_volume" :: waited 0.018s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65ef438-5f5d-48cb-8da0-7ce1fb4a9773]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:11 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff
Feb 28 01:27:11 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:12 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.427s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:12 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Deleted volume successfully.
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2ff4b478-0d19-4237-b105-26b819ccd60c tempest-CinderUnicodeTest-299469770 None] Lock "cinder-9d2b0b73-0568-4960-b281-b0983922716a-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:12 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff" returned: 0 in 0.488s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:12 devstack sudo[88735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff
Feb 28 01:27:12 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:12 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff" returned: 0 in 0.394s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Lock "cinder-quobyte-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff" released by "delete_volume" :: held 0.902s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Created reservations ['d417bb54-fbc7-4aff-8b97-8d9ec984a388', 'ec79942f-33c0-4b90-8de0-de26b09d6a04', '80292f9a-4777-4178-9cab-3ca2d76d0d98', '1155c47e-225e-4ad0-a2a5-f10b5eab4bb9'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:12 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:12 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:13 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.422s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:13 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Deleted volume successfully.
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2fe8564b-aa32-49b4-beff-4cf37b4d65be tempest-CinderUnicodeTest-299469770 None] Lock "cinder-05d9ac8a-c16c-465a-8a2a-bdd6e81140ff-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (749c7271-21f7-49ff-a50b-c930be52be61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a1b607-416d-4bf2-bf48-05d991275131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a1b607-416d-4bf2-bf48-05d991275131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2099099013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b9e19a-3821-4ca8-b2c2-f398f9258aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:13Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a742ba-02e6-40e7-b21b-edf344c9f739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a742ba-02e6-40e7-b21b-edf344c9f739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d2bd42-9be4-4f54-9110-20a05608698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d2bd42-9be4-4f54-9110-20a05608698c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b9e19a-3821-4ca8-b2c2-f398f9258aed', 'volume_name': 'volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea79e0fd-8d3d-41aa-8904-a6632c5dee84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea79e0fd-8d3d-41aa-8904-a6632c5dee84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7a22d6-b231-4d95-8d8a-7e3b1691314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:13 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Volume 87b9e19a-3821-4ca8-b2c2-f398f9258aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed', 'volume_size': 1}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2099099013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b9e19a-3821-4ca8-b2c2-f398f9258aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:13Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Creating volume 87b9e19a-3821-4ca8-b2c2-f398f9258aed {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:13 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:13 devstack sudo[88741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed 1073741824
Feb 28 01:27:13 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:14 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed 1073741824" returned: 0 in 0.539s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:14 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed
Feb 28 01:27:14 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:14 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed" returned: 0 in 0.461s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7a22d6-b231-4d95-8d8a-7e3b1691314a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d469880e-deb2-4003-9dbc-7d2b28b5f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:14 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Volume volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed (87b9e19a-3821-4ca8-b2c2-f398f9258aed): created successfully
Feb 28 01:27:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d469880e-deb2-4003-9dbc-7d2b28b5f002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (749c7271-21f7-49ff-a50b-c930be52be61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:14 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7df51093-01bd-455c-a3c6-bfde47ca1384 tempest-VolumesActionsTest-2139482103 None] Created volume successfully.
Feb 28 01:27:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Acquiring lock "cinder-87b9e19a-3821-4ca8-b2c2-f398f9258aed-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-87b9e19a-3821-4ca8-b2c2-f398f9258aed-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Acquiring lock "cinder-quobyte-87b9e19a-3821-4ca8-b2c2-f398f9258aed" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:15 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-quobyte-87b9e19a-3821-4ca8-b2c2-f398f9258aed" acquired by "delete_volume" :: waited 0.014s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:15 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e24e093-7baa-42b1-adc3-dd14fa8b22f0]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:15 devstack sudo[88749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed
Feb 28 01:27:15 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:16 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed" returned: 0 in 0.498s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:16 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed
Feb 28 01:27:16 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:16 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-87b9e19a-3821-4ca8-b2c2-f398f9258aed" returned: 0 in 0.400s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-quobyte-87b9e19a-3821-4ca8-b2c2-f398f9258aed" released by "delete_volume" :: held 0.924s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Created reservations ['56edf6ad-8a6d-4521-aefe-ab797e403dd0', '2376d15f-a32b-45a6-88b5-f2ce231a7918', '9bf4a126-d44b-4990-8f27-00950490734a', '5d5d6ab3-d129-4906-8127-cc46dbc02743'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:16 devstack sudo[88757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:16 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (008156c0-d7db-4c33-bd03-b0d6e490c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b8f9be-672b-42db-8c7b-f537f6bb62b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b8f9be-672b-42db-8c7b-f537f6bb62b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1218700827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4224d32b-4f69-4c30-a1a1-59107c46b11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:17Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4481ef50-09e4-4808-8ceb-f1b2aed64151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4481ef50-09e4-4808-8ceb-f1b2aed64151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73d1fe9-dad2-4ef6-a1bd-37761460fffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73d1fe9-dad2-4ef6-a1bd-37761460fffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4224d32b-4f69-4c30-a1a1-59107c46b11c', 'volume_name': 'volume-4224d32b-4f69-4c30-a1a1-59107c46b11c', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e428ab-e47d-4d04-bf42-ab9f9ccf4d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e428ab-e47d-4d04-bf42-ab9f9ccf4d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac6a073-1fa3-472a-bcb8-23b0c7140f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:17 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Volume 4224d32b-4f69-4c30-a1a1-59107c46b11c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4224d32b-4f69-4c30-a1a1-59107c46b11c', 'volume_size': 1}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1218700827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4224d32b-4f69-4c30-a1a1-59107c46b11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:17Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Creating volume 4224d32b-4f69-4c30-a1a1-59107c46b11c {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:17 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:17 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c 1073741824
Feb 28 01:27:17 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:17 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.548s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:17 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Deleted volume successfully.
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d37f5acb-8423-4a0e-9fa7-c8f34bf10995 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-87b9e19a-3821-4ca8-b2c2-f398f9258aed-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:17 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c 1073741824" returned: 0 in 0.491s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:17 devstack sudo[88765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c
Feb 28 01:27:17 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:18 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c" returned: 0 in 0.399s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:18 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:18 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac6a073-1fa3-472a-bcb8-23b0c7140f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4224d32b-4f69-4c30-a1a1-59107c46b11c', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:18 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a263f8e9-94df-413d-b0e5-4c164604563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:18 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Volume volume-4224d32b-4f69-4c30-a1a1-59107c46b11c (4224d32b-4f69-4c30-a1a1-59107c46b11c): created successfully
Feb 28 01:27:18 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a263f8e9-94df-413d-b0e5-4c164604563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:18 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (008156c0-d7db-4c33-bd03-b0d6e490c399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:18 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-28b63718-0698-4c83-82c2-df1a070feeb3 tempest-VolumesActionsTest-2139482103 None] Created volume successfully.
Feb 28 01:27:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Acquiring lock "cinder-4224d32b-4f69-4c30-a1a1-59107c46b11c-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Lock "cinder-4224d32b-4f69-4c30-a1a1-59107c46b11c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Acquiring lock "cinder-quobyte-4224d32b-4f69-4c30-a1a1-59107c46b11c" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Lock "cinder-quobyte-4224d32b-4f69-4c30-a1a1-59107c46b11c" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:19 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d5477e-13b8-4fb6-9b34-2d0edf1c84ee]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:19 devstack sudo[88768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c
Feb 28 01:27:19 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:19 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c" returned: 0 in 0.531s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:19 devstack sudo[88773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c
Feb 28 01:27:19 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:20 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4224d32b-4f69-4c30-a1a1-59107c46b11c" returned: 0 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Lock "cinder-quobyte-4224d32b-4f69-4c30-a1a1-59107c46b11c" released by "delete_volume" :: held 1.008s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Created reservations ['75749924-f272-4f5e-8ab5-d12387d1b856', 'f954830e-d7eb-4b7f-9c67-fd5f5ee51514', '6eb90070-17e0-4252-a6fc-50cc92c0045a', '0a96ac4d-b008-4e7e-ba05-511a8c2673cb'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:20 devstack sudo[88776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:20 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:20 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.435s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Deleted volume successfully.
Feb 28 01:27:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-0b68598e-b42a-4d6c-b7b3-87417752f48d tempest-VolumesActionsTest-1480922504 None] Lock "cinder-4224d32b-4f69-4c30-a1a1-59107c46b11c-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (bf206006-a1a1-4102-a09b-ee2ab854f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea46e6d3-53e0-47af-a8d0-5c1c28dae2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea46e6d3-53e0-47af-a8d0-5c1c28dae2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1253216902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:22Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c0e837-b870-4772-8cb6-5dab448b0009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c0e837-b870-4772-8cb6-5dab448b0009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83589477-fc49-45ee-9d65-bf5bc509645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83589477-fc49-45ee-9d65-bf5bc509645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1', 'volume_name': 'volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7b8c80-89a4-4b31-a87e-1c9982157161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7b8c80-89a4-4b31-a87e-1c9982157161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b5700c-c1bd-43bc-9aa7-eeec5d491e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:21 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Volume cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1', 'volume_size': 1}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1253216902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:22Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Creating volume cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:21 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:21 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1 1073741824
Feb 28 01:27:21 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:22 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1 1073741824" returned: 0 in 0.560s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:22 devstack sudo[88785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1
Feb 28 01:27:22 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:22 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1" returned: 0 in 0.500s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b5700c-c1bd-43bc-9aa7-eeec5d491e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed8ce8c-6fac-4c1d-abb0-7f31b68655f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:23 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Volume volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1 (cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1): created successfully
Feb 28 01:27:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed8ce8c-6fac-4c1d-abb0-7f31b68655f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (bf206006-a1a1-4102-a09b-ee2ab854f936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:23 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-30f61e5c-0167-4996-8c73-9987b40e0d57 tempest-VolumesActionsTest-2139482103 None] Created volume successfully.
Feb 28 01:27:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Acquiring lock "cinder-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Acquiring lock "cinder-quobyte-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-quobyte-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:24 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6f707f-8d04-464c-a925-71bc534814ed]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:24 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1
Feb 28 01:27:24 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:24 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1" returned: 0 in 0.580s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:24 devstack sudo[88793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1
Feb 28 01:27:24 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:25 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1" returned: 0 in 0.439s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-quobyte-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1" released by "delete_volume" :: held 1.043s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Created reservations ['f25b5634-1262-45cd-96ff-0add02a47a56', '030e549c-63fa-4de4-bad5-0064688494b9', '9693fb26-f869-4bb8-ab6a-aede4d849214', 'a14f31cb-9118-4533-8df0-0c5f36e58494'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:25 devstack sudo[88796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:25 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Flow 'volume_create_manager' (1293c438-2827-4842-bbc6-195f1460cc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22c8354-eead-4d3d-ae5a-92e97fde72ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22c8354-eead-4d3d-ae5a-92e97fde72ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1993023331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e153505b-ebbd-492a-987b-5f666d4b7baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee669274da3a48c1b44ed6492dcf268f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:25Z,use_quota=True,user_id='67660e87c31843859bd327fa7fb0c3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f48754-c872-49a9-b0c9-ad936a6a1636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f48754-c872-49a9-b0c9-ad936a6a1636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2429e698-a690-4012-9081-97c67a4996fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2429e698-a690-4012-9081-97c67a4996fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e153505b-ebbd-492a-987b-5f666d4b7baf', 'volume_name': 'volume-e153505b-ebbd-492a-987b-5f666d4b7baf', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ec8b6f-4df0-437f-ab6c-c8b594e5bea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ec8b6f-4df0-437f-ab6c-c8b594e5bea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b213d4ae-9a5c-48a0-90e3-2379a18fd264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:25 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Volume e153505b-ebbd-492a-987b-5f666d4b7baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e153505b-ebbd-492a-987b-5f666d4b7baf', 'volume_size': 1}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1993023331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e153505b-ebbd-492a-987b-5f666d4b7baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee669274da3a48c1b44ed6492dcf268f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:25Z,use_quota=True,user_id='67660e87c31843859bd327fa7fb0c3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Creating volume e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:25 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:25 devstack sudo[88798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf 1073741824
Feb 28 01:27:25 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:25 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.399s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:25 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Deleted volume successfully.
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e9d2eb1b-2cd5-4d00-b203-18f3d86ebc60 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-cb6dfe32-2a4f-4ee4-8ec6-b49633b9b7b1-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:25 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf 1073741824" returned: 0 in 0.480s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:25 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf
Feb 28 01:27:25 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:26 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf" returned: 0 in 0.402s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b213d4ae-9a5c-48a0-90e3-2379a18fd264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e153505b-ebbd-492a-987b-5f666d4b7baf', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b965dc-f89e-429d-847c-4b37d0145f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:26 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Volume volume-e153505b-ebbd-492a-987b-5f666d4b7baf (e153505b-ebbd-492a-987b-5f666d4b7baf): created successfully
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b965dc-f89e-429d-847c-4b37d0145f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Flow 'volume_create_manager' (1293c438-2827-4842-bbc6-195f1460cc7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8b2fef01-b046-4882-9d50-75bf229dac10 tempest-SnapshotDependencyTests-911716158 None] Created volume successfully.
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (42331acc-fe7d-45aa-95f3-6306030750ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c120c0d-0b13-4b74-8f4f-606ba1365161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c120c0d-0b13-4b74-8f4f-606ba1365161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-100541141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93061c7d-6a4f-4273-a1b6-b28ba00b7cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:27Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcfb77c5-d043-4feb-972f-ef03ab62a50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcfb77c5-d043-4feb-972f-ef03ab62a50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793a25d6-55dd-4a1e-ad0e-7e39eac380d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793a25d6-55dd-4a1e-ad0e-7e39eac380d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93061c7d-6a4f-4273-a1b6-b28ba00b7cab', 'volume_name': 'volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a925dda0-4dd9-4524-a622-3cfc43643401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a925dda0-4dd9-4524-a622-3cfc43643401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97868408-d181-43b0-8da1-fd0fb431787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:26 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Volume 93061c7d-6a4f-4273-a1b6-b28ba00b7cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab', 'volume_size': 1}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-100541141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93061c7d-6a4f-4273-a1b6-b28ba00b7cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:27Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Creating volume 93061c7d-6a4f-4273-a1b6-b28ba00b7cab {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:26 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:26 devstack sudo[88807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab 1073741824
Feb 28 01:27:26 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:27 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab 1073741824" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:27 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab
Feb 28 01:27:27 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:27 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab" returned: 0 in 0.392s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97868408-d181-43b0-8da1-fd0fb431787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b2d8a2-9caf-4933-80a5-175a41c2731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:27 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Volume volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab (93061c7d-6a4f-4273-a1b6-b28ba00b7cab): created successfully
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b2d8a2-9caf-4933-80a5-175a41c2731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (42331acc-fe7d-45aa-95f3-6306030750ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:27 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-69267f04-b1f6-484c-95c1-e208fc74463d tempest-VolumesActionsTest-2139482103 None] Created volume successfully.
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Creating offline snapshot b14a28a1-a514-4b82-929f-deba07fc3ba9 of volume e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d414f5-b900-46fe-b4e0-6513af4e8b5a]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:27 devstack sudo[88815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf
Feb 28 01:27:27 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Acquiring lock "cinder-93061c7d-6a4f-4273-a1b6-b28ba00b7cab-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-93061c7d-6a4f-4273-a1b6-b28ba00b7cab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Acquiring lock "cinder-quobyte-93061c7d-6a4f-4273-a1b6-b28ba00b7cab" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-quobyte-93061c7d-6a4f-4273-a1b6-b28ba00b7cab" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[25852c8d-b2b1-4305-9b2f-5c8a6286e0a9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:27 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab
Feb 28 01:27:27 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:28 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf" returned: 0 in 0.506s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:28 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 1G
Feb 28 01:27:28 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:28 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab" returned: 0 in 0.483s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:28 devstack sudo[88827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab
Feb 28 01:27:28 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:28 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 1G" returned: 0 in 0.441s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e153505b-ebbd-492a-987b-5f666d4b7baf -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:28 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e153505b-ebbd-492a-987b-5f666d4b7baf -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9
Feb 28 01:27:28 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:28 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-93061c7d-6a4f-4273-a1b6-b28ba00b7cab" returned: 0 in 0.425s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-quobyte-93061c7d-6a4f-4273-a1b6-b28ba00b7cab" released by "delete_volume" :: held 0.930s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Created reservations ['55fd7c90-42e5-4693-8d2a-e7528e0dc2ad', 'b30d0ff8-cddf-4ad3-8834-f6d75864a143', 'fa8d7c65-382b-43ce-bbbe-2af7a01ed733', '88fb5c35-cd24-4541-a64f-54bd1db28c51'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:28 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:28 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:28 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e153505b-ebbd-492a-987b-5f666d4b7baf -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9" returned: 0 in 0.442s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:28 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 is being set with open permissions: ugo+rw
Feb 28 01:27:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:29 devstack sudo[88840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9
Feb 28 01:27:29 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (5c10596c-e685-423c-b89d-4790f02ea605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9dcda21-70ea-4525-9eee-2e455a343f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9dcda21-70ea-4525-9eee-2e455a343f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1948538073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e76644d2-ccff-4893-96dd-d597a07dc08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:29Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae726045-b04a-4399-8839-9f6d0a2efde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae726045-b04a-4399-8839-9f6d0a2efde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86554eaf-236e-4cbe-906c-366660b514b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86554eaf-236e-4cbe-906c-366660b514b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e76644d2-ccff-4893-96dd-d597a07dc08d', 'volume_name': 'volume-e76644d2-ccff-4893-96dd-d597a07dc08d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1242000-7775-4a68-8a7b-cf9f67bfc145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1242000-7775-4a68-8a7b-cf9f67bfc145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06d5528-ea54-4841-954b-6077214b5ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:29 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Volume e76644d2-ccff-4893-96dd-d597a07dc08d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e76644d2-ccff-4893-96dd-d597a07dc08d', 'volume_size': 1}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:29 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.421s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:29 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Deleted volume successfully.
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28353cf2-3e75-4e1e-a3aa-65c65005f432 tempest-VolumesActionsTest-1480922504 None] Lock "cinder-93061c7d-6a4f-4273-a1b6-b28ba00b7cab-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:29 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9" returned: 0 in 0.418s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:29 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.info
Feb 28 01:27:29 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:29 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.info" returned: 0 in 0.415s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:29 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.info is being set with open permissions: ugo+rw
Feb 28 01:27:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:29 devstack sudo[88847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.info
Feb 28 01:27:29 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:30 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.info" returned: 0 in 0.393s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.677s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1948538073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e76644d2-ccff-4893-96dd-d597a07dc08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd86c0e814744c590f225a56029a181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:29Z,use_quota=True,user_id='96deeb202d7a4cfbabab6c996a755305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Creating volume e76644d2-ccff-4893-96dd-d597a07dc08d {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:30 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:30 devstack sudo[88850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d 1073741824
Feb 28 01:27:30 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:30 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-79f6c4eb-fd61-4d23-95db-90227cf680f7 tempest-SnapshotDependencyTests-911716158 None] Create snapshot completed successfully
Feb 28 01:27:30 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d 1073741824" returned: 0 in 0.475s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:30 devstack sudo[88855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d
Feb 28 01:27:30 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Flow 'volume_create_manager' (59c1c5b9-0c15-4aab-b561-5a0442b7a310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a868d29-e751-4193-b22c-0e80d56c69c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a868d29-e751-4193-b22c-0e80d56c69c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f695c10-dcd8-435e-b57d-26116b7582ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee669274da3a48c1b44ed6492dcf268f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b14a28a1-a514-4b82-929f-deba07fc3ba9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:31Z,use_quota=True,user_id='67660e87c31843859bd327fa7fb0c3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4722b3-baed-4177-80fa-3c97f36e7af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4722b3-baed-4177-80fa-3c97f36e7af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0631718-3bf4-4dc0-a8da-de4e95740624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0631718-3bf4-4dc0-a8da-de4e95740624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f695c10-dcd8-435e-b57d-26116b7582ed', 'volume_name': 'volume-2f695c10-dcd8-435e-b57d-26116b7582ed', 'volume_size': 1, 'snapshot_id': 'b14a28a1-a514-4b82-929f-deba07fc3ba9'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af97bbc-8d09-4ba6-a60d-c449cd14c794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af97bbc-8d09-4ba6-a60d-c449cd14c794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6dcde7-9886-49ff-abdb-404d21a6a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:31 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Volume 2f695c10-dcd8-435e-b57d-26116b7582ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f695c10-dcd8-435e-b57d-26116b7582ed', 'volume_size': 1, 'snapshot_id': 'b14a28a1-a514-4b82-929f-deba07fc3ba9'}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:31 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d" returned: 0 in 0.400s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.052s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "cinder-quobyte-b14a28a1-a514-4b82-929f-deba07fc3ba9-2f695c10-dcd8-435e-b57d-26116b7582ed" by "_create_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06d5528-ea54-4841-954b-6077214b5ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e76644d2-ccff-4893-96dd-d597a07dc08d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10812e9-f618-4dae-9faa-f2e1de911c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-b14a28a1-a514-4b82-929f-deba07fc3ba9-2f695c10-dcd8-435e-b57d-26116b7582ed" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Creating volume 2f695c10-dcd8-435e-b57d-26116b7582ed from snapshot b14a28a1-a514-4b82-929f-deba07fc3ba9 {{(pid=82470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "cinder-quobyte-2f695c10-dcd8-435e-b57d-26116b7582ed" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:31 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Volume volume-e76644d2-ccff-4893-96dd-d597a07dc08d (e76644d2-ccff-4893-96dd-d597a07dc08d): created successfully
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10812e9-f618-4dae-9faa-f2e1de911c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Flow 'volume_create_manager' (5c10596c-e685-423c-b89d-4790f02ea605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-2f695c10-dcd8-435e-b57d-26116b7582ed" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] snapshot: b14a28a1-a514-4b82-929f-deba07fc3ba9, volume: 2f695c10-dcd8-435e-b57d-26116b7582ed,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:27:31 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-fa99d6fc-a405-4778-b682-f60026732688 tempest-VolumesActionsTest-2139482103 None] Created volume successfully.
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a18fef5-37d5-4526-bb18-7ea85b62e8eb]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:31 devstack sudo[88858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9
Feb 28 01:27:31 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:31 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9" returned: 0 in 0.453s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e153505b-ebbd-492a-987b-5f666d4b7baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07a2145-2640-497a-a1df-3a1364b84b72]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:31 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf
Feb 28 01:27:31 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:32 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf" returned: 0 in 0.461s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:32 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:27:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:32 devstack sudo[88869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed
Feb 28 01:27:32 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Acquiring lock "cinder-e76644d2-ccff-4893-96dd-d597a07dc08d-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Lock "cinder-e76644d2-ccff-4893-96dd-d597a07dc08d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Acquiring lock "cinder-quobyte-e76644d2-ccff-4893-96dd-d597a07dc08d" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Lock "cinder-quobyte-e76644d2-ccff-4893-96dd-d597a07dc08d" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:33 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[134cd61a-1885-41b3-9717-a36b6daff8a4]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:33 devstack sudo[88882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d
Feb 28 01:27:33 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:34 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d" returned: 0 in 1.300s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:34 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed" returned: 0 in 2.177s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:34 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d
Feb 28 01:27:34 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b917a0f5-9be6-4044-93cd-5380205fb61e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:34 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf
Feb 28 01:27:34 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:34 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e76644d2-ccff-4893-96dd-d597a07dc08d" returned: 0 in 0.401s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Lock "cinder-quobyte-e76644d2-ccff-4893-96dd-d597a07dc08d" released by "delete_volume" :: held 1.739s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Created reservations ['be37e535-e379-4063-bc2e-c00f8d077eaa', '0e9aef4b-8e20-410a-9a0c-d88bdc82632b', 'a2560a74-e4fc-4bd6-be6a-db139740153f', 'c52b5aae-3f33-412e-9d6b-a5bf65096cf0'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:34 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:34 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:34 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf" returned: 0 in 0.604s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:27:34 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Converted 1024.00 MB image at 470.15 MB/s
Feb 28 01:27:34 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed is being set with open permissions: ugo+rw
Feb 28 01:27:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:34 devstack sudo[88897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed
Feb 28 01:27:34 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:35 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.424s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:35 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Deleted volume successfully.
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-28652e2c-c134-44a4-a938-3cb5880c9cae tempest-VolumesActionsTest-2139482103 None] Lock "cinder-e76644d2-ccff-4893-96dd-d597a07dc08d-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:35 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed" returned: 0 in 0.430s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-2f695c10-dcd8-435e-b57d-26116b7582ed" released by "_copy_volume_from_snapshot" :: held 4.184s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-b14a28a1-a514-4b82-929f-deba07fc3ba9-2f695c10-dcd8-435e-b57d-26116b7582ed" released by "_create_volume_from_snapshot" :: held 4.212s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.235s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6dcde7-9886-49ff-abdb-404d21a6a953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f695c10-dcd8-435e-b57d-26116b7582ed', 'volume_size': 1, 'snapshot_id': 'b14a28a1-a514-4b82-929f-deba07fc3ba9'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b203ec58-56d0-4da4-a105-eacede1a3e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:35 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Volume volume-2f695c10-dcd8-435e-b57d-26116b7582ed (2f695c10-dcd8-435e-b57d-26116b7582ed): created successfully
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b203ec58-56d0-4da4-a105-eacede1a3e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:35 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Flow 'volume_create_manager' (59c1c5b9-0c15-4aab-b561-5a0442b7a310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:35 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e4aa0a12-d973-4972-92c6-63ed0f6956bd tempest-SnapshotDependencyTests-911716158 None] Created volume successfully.
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "cinder-b14a28a1-a514-4b82-929f-deba07fc3ba9-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-b14a28a1-a514-4b82-929f-deba07fc3ba9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "cinder-quobyte-e153505b-ebbd-492a-987b-5f666d4b7baf" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-e153505b-ebbd-492a-987b-5f666d4b7baf" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "cinder-quobyte-b14a28a1-a514-4b82-929f-deba07fc3ba9" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-b14a28a1-a514-4b82-929f-deba07fc3ba9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Deleting offline snapshot b14a28a1-a514-4b82-929f-deba07fc3ba9 of volume e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] snapshot_file for this snap is: volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e401fb4-c5f0-43b3-a20a-36db7994e31b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:36 devstack sudo[88902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9
Feb 28 01:27:36 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:36 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9" returned: 0 in 0.531s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e153505b-ebbd-492a-987b-5f666d4b7baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:27:37 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[322fb771-bdbe-452e-815c-219f2372b1c4]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:37 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf
Feb 28 01:27:37 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:37 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf" returned: 0 in 0.511s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:37 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9
Feb 28 01:27:37 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:38 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9" returned: 0 in 0.496s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:38 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9
Feb 28 01:27:38 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:38 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf.b14a28a1-a514-4b82-929f-deba07fc3ba9" returned: 0 in 0.412s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:38 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=115,cinder:INSERT=35,cinder:UPDATE=160,cinder:DELETE=13 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:27:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-b14a28a1-a514-4b82-929f-deba07fc3ba9" released by "_delete_snapshot" :: held 2.013s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-e153505b-ebbd-492a-987b-5f666d4b7baf" released by "delete_snapshot" :: held 2.031s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:38 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Created reservations ['07678cc0-e7ad-4803-a0d8-8a6674ed93c8', 'a7602493-ded1-4b82-860a-b7d9d25b691f', '1bd1a8fd-9eff-4334-a024-a67f9d3c8fe9', '9011b9f4-a41a-4fb6-8f86-d888636ccf39'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:38 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Delete snapshot completed successfully.
Feb 28 01:27:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-220f6b1a-7401-41ea-861b-7887efc31487 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-b14a28a1-a514-4b82-929f-deba07fc3ba9-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "cinder-e153505b-ebbd-492a-987b-5f666d4b7baf-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-e153505b-ebbd-492a-987b-5f666d4b7baf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "cinder-quobyte-e153505b-ebbd-492a-987b-5f666d4b7baf" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-e153505b-ebbd-492a-987b-5f666d4b7baf" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:39 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c15c74-4e89-4a08-a217-6c607cb5462f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:39 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf
Feb 28 01:27:39 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:40 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf" returned: 0 in 0.547s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:40 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf
Feb 28 01:27:40 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:40 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e153505b-ebbd-492a-987b-5f666d4b7baf" returned: 0 in 0.443s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-e153505b-ebbd-492a-987b-5f666d4b7baf" released by "delete_volume" :: held 1.020s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Created reservations ['288b42ce-e3db-4eae-a4af-34037f74db31', '6b96b4e6-5d28-4144-83d2-39cd8452df06', '6515787e-deba-461c-b971-83d534f14a8f', '70eca5ab-b713-4446-a267-3813910ff90d'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:40 devstack sudo[88971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:40 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:41 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.421s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:41 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:41 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Deleted volume successfully.
Feb 28 01:27:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4b9d903e-bf2c-4720-9bb1-9a9c63c5fc23 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-e153505b-ebbd-492a-987b-5f666d4b7baf-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "cinder-2f695c10-dcd8-435e-b57d-26116b7582ed-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-2f695c10-dcd8-435e-b57d-26116b7582ed-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "cinder-quobyte-2f695c10-dcd8-435e-b57d-26116b7582ed" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-2f695c10-dcd8-435e-b57d-26116b7582ed" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:41 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3d5a91-77ed-483a-b30b-ad8e33c9f943]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:41 devstack sudo[88975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed
Feb 28 01:27:41 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Flow 'volume_create_manager' (55ea30b8-2a8c-4622-831e-355f761a4f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45106868-9223-4ce4-b243-d5449eb74875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45106868-9223-4ce4-b243-d5449eb74875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2061402902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26fcfbd-9b41-49a2-adbd-afed08211908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8222596034b54280b9614887d4f95b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:42Z,use_quota=True,user_id='f512c4a523c241cf98738d649f81728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd584c3b-4929-425f-93f6-9c5112b4223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd584c3b-4929-425f-93f6-9c5112b4223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542b41d5-e9f1-4414-a9fb-0fe9976a92a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542b41d5-e9f1-4414-a9fb-0fe9976a92a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26fcfbd-9b41-49a2-adbd-afed08211908', 'volume_name': 'volume-a26fcfbd-9b41-49a2-adbd-afed08211908', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c962c128-dc64-4433-8098-e9f5227c1eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c962c128-dc64-4433-8098-e9f5227c1eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfb26eb-1f6a-4bd2-9287-5a050fd0fdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Volume a26fcfbd-9b41-49a2-adbd-afed08211908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26fcfbd-9b41-49a2-adbd-afed08211908', 'volume_size': 1}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2061402902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26fcfbd-9b41-49a2-adbd-afed08211908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8222596034b54280b9614887d4f95b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:42Z,use_quota=True,user_id='f512c4a523c241cf98738d649f81728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Creating volume a26fcfbd-9b41-49a2-adbd-afed08211908 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:42 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:42 devstack sudo[88977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908 1073741824
Feb 28 01:27:42 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:42 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed" returned: 0 in 0.504s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:42 devstack sudo[88982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed
Feb 28 01:27:42 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:42 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908 1073741824" returned: 0 in 0.476s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=123,cinder:INSERT=39,cinder:UPDATE=145,cinder:DELETE=12 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:42 devstack sudo[88987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908
Feb 28 01:27:42 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:42 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2f695c10-dcd8-435e-b57d-26116b7582ed" returned: 0 in 0.412s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-quobyte-2f695c10-dcd8-435e-b57d-26116b7582ed" released by "delete_volume" :: held 0.942s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Created reservations ['322863cf-3b81-443a-85b8-1d7550c4c6f6', 'db2fce19-7e37-49ef-ab10-de105770e9fe', 'b8221541-168f-4b5d-9ffb-895acfb9c8cc', '1f7e2ccd-f210-4ac3-9e61-05a2da46f590'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:42 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:42 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:43 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908" returned: 0 in 0.451s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfb26eb-1f6a-4bd2-9287-5a050fd0fdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26fcfbd-9b41-49a2-adbd-afed08211908', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0caffe-a3b9-4401-ba48-b19738ca0e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:43 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Volume volume-a26fcfbd-9b41-49a2-adbd-afed08211908 (a26fcfbd-9b41-49a2-adbd-afed08211908): created successfully
Feb 28 01:27:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0caffe-a3b9-4401-ba48-b19738ca0e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Flow 'volume_create_manager' (55ea30b8-2a8c-4622-831e-355f761a4f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-f0e4139d-7543-4270-bfa7-0d43fb5259b8 tempest-VolumesListAdminTestJSON-745569985 None] Created volume successfully.
Feb 28 01:27:43 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.461s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:43 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Deleted volume successfully.
Feb 28 01:27:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c1cbecf1-c2a3-425d-bb07-6ccce775c777 tempest-SnapshotDependencyTests-911716158 None] Lock "cinder-2f695c10-dcd8-435e-b57d-26116b7582ed-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Flow 'volume_create_manager' (67469af6-bb77-4262-b94e-c68a48fbb7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f9cd1f-f592-41fd-8fe1-a00c14be3070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f9cd1f-f592-41fd-8fe1-a00c14be3070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-599066815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebc3e97-63a7-444f-9e99-bbb577b710c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8222596034b54280b9614887d4f95b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:44Z,use_quota=True,user_id='f512c4a523c241cf98738d649f81728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7421d136-7d50-47b9-bc8d-f80d5f0ae25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7421d136-7d50-47b9-bc8d-f80d5f0ae25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1240ad-44c4-496a-b935-7887e5f078da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1240ad-44c4-496a-b935-7887e5f078da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aebc3e97-63a7-444f-9e99-bbb577b710c6', 'volume_name': 'volume-aebc3e97-63a7-444f-9e99-bbb577b710c6', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d59f11-0962-4f13-84ad-985d4668a180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d59f11-0962-4f13-84ad-985d4668a180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee95b66-6efa-4172-9b03-07518a289f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:44 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Volume aebc3e97-63a7-444f-9e99-bbb577b710c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aebc3e97-63a7-444f-9e99-bbb577b710c6', 'volume_size': 1}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-599066815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebc3e97-63a7-444f-9e99-bbb577b710c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8222596034b54280b9614887d4f95b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:44Z,use_quota=True,user_id='f512c4a523c241cf98738d649f81728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Creating volume aebc3e97-63a7-444f-9e99-bbb577b710c6 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:44 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:44 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6 1073741824
Feb 28 01:27:44 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:45 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6 1073741824" returned: 0 in 0.510s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:45 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6
Feb 28 01:27:45 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:45 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6" returned: 0 in 0.455s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee95b66-6efa-4172-9b03-07518a289f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebc3e97-63a7-444f-9e99-bbb577b710c6', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ec7cc6-9846-4a1e-ac88-2f0babdc7089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:45 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Volume volume-aebc3e97-63a7-444f-9e99-bbb577b710c6 (aebc3e97-63a7-444f-9e99-bbb577b710c6): created successfully
Feb 28 01:27:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ec7cc6-9846-4a1e-ac88-2f0babdc7089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Flow 'volume_create_manager' (67469af6-bb77-4262-b94e-c68a48fbb7b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:45 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1da1fa28-6871-43c6-a188-840d2b1b398d tempest-VolumesListAdminTestJSON-745569985 None] Created volume successfully.
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Flow 'volume_create_manager' (c640645b-55cc-44a0-8448-39d5ca7a7b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307e4a5a-7367-4d3b-8ff6-26beb04d925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307e4a5a-7367-4d3b-8ff6-26beb04d925f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-732317283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab0969f-c043-4e97-816b-69525a474255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8222596034b54280b9614887d4f95b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:47Z,use_quota=True,user_id='f512c4a523c241cf98738d649f81728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6000f981-f17c-453f-836f-6e101169d394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6000f981-f17c-453f-836f-6e101169d394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d810f33a-df72-46a8-a0d3-87045ff9393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d810f33a-df72-46a8-a0d3-87045ff9393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab0969f-c043-4e97-816b-69525a474255', 'volume_name': 'volume-dab0969f-c043-4e97-816b-69525a474255', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c41a44-a61c-4b7a-9f38-11959f5d1210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c41a44-a61c-4b7a-9f38-11959f5d1210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00552a3e-ba98-44e0-8384-c33983fcf97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:46 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Volume dab0969f-c043-4e97-816b-69525a474255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab0969f-c043-4e97-816b-69525a474255', 'volume_size': 1}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-732317283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab0969f-c043-4e97-816b-69525a474255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8222596034b54280b9614887d4f95b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:47Z,use_quota=True,user_id='f512c4a523c241cf98738d649f81728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Creating volume dab0969f-c043-4e97-816b-69525a474255 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:46 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:47 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255 1073741824
Feb 28 01:27:47 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:47 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255 1073741824" returned: 0 in 0.533s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:47 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255
Feb 28 01:27:47 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:47 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255" returned: 0 in 0.453s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00552a3e-ba98-44e0-8384-c33983fcf97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab0969f-c043-4e97-816b-69525a474255', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21baaf5f-4c6b-4810-a307-1f6833c22816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:48 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Volume volume-dab0969f-c043-4e97-816b-69525a474255 (dab0969f-c043-4e97-816b-69525a474255): created successfully
Feb 28 01:27:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21baaf5f-4c6b-4810-a307-1f6833c22816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Flow 'volume_create_manager' (c640645b-55cc-44a0-8448-39d5ca7a7b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:48 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-770d117b-ce2e-46b6-913d-2df4864451da tempest-VolumesListAdminTestJSON-745569985 None] Created volume successfully.
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Flow 'volume_create_manager' (292ecbe7-eb45-4fc0-8f44-dcb2dffc06ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47f8b01-7a8d-4b40-b365-03563221faa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47f8b01-7a8d-4b40-b365-03563221faa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddbf714-09be-4613-b8e6-8d8365cbf26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24acad6e059455294520641e543fefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:49Z,use_quota=True,user_id='8c26dec5c0c14263862809aee91d06b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00beac3a-0f30-4bec-8b4c-f583de4604c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00beac3a-0f30-4bec-8b4c-f583de4604c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db380289-58bc-4315-8bc9-9d3e9c6cc7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db380289-58bc-4315-8bc9-9d3e9c6cc7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ddbf714-09be-4613-b8e6-8d8365cbf26b', 'volume_name': 'volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd1a447-3e37-476b-9a9e-1e8950f2c47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd1a447-3e37-476b-9a9e-1e8950f2c47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40114762-9dbe-4a33-9ef4-ad8b8249a269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:49 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Volume 7ddbf714-09be-4613-b8e6-8d8365cbf26b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b', 'volume_size': 1}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddbf714-09be-4613-b8e6-8d8365cbf26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24acad6e059455294520641e543fefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:49Z,use_quota=True,user_id='8c26dec5c0c14263862809aee91d06b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Creating volume 7ddbf714-09be-4613-b8e6-8d8365cbf26b {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:49 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:49 devstack sudo[89016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b 1073741824
Feb 28 01:27:49 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:49 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b 1073741824" returned: 0 in 0.463s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:49 devstack sudo[89021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b
Feb 28 01:27:49 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:50 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b" returned: 0 in 0.395s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40114762-9dbe-4a33-9ef4-ad8b8249a269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4eca717-255d-4bc1-b696-9aade67ad76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:50 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Volume volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b (7ddbf714-09be-4613-b8e6-8d8365cbf26b): created successfully
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4eca717-255d-4bc1-b696-9aade67ad76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Flow 'volume_create_manager' (292ecbe7-eb45-4fc0-8f44-dcb2dffc06ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:50 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2ec59274-262a-48bb-9348-f3c178060192 tempest-VolumesListAdminTestJSON-1568956775 None] Created volume successfully.
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Acquiring lock "cinder-7ddbf714-09be-4613-b8e6-8d8365cbf26b-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Lock "cinder-7ddbf714-09be-4613-b8e6-8d8365cbf26b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Acquiring lock "cinder-quobyte-7ddbf714-09be-4613-b8e6-8d8365cbf26b" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Lock "cinder-quobyte-7ddbf714-09be-4613-b8e6-8d8365cbf26b" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[38813135-623a-4955-ab04-eccc6bf62138]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "cinder-dab0969f-c043-4e97-816b-69525a474255-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-dab0969f-c043-4e97-816b-69525a474255-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "cinder-quobyte-dab0969f-c043-4e97-816b-69525a474255" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-quobyte-dab0969f-c043-4e97-816b-69525a474255" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:50 devstack sudo[89024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b
Feb 28 01:27:50 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[892351c3-b82a-4b5e-85ac-af4270ebcec5]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:50 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255
Feb 28 01:27:50 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:51 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b" returned: 0 in 0.469s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:51 devstack sudo[89032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b
Feb 28 01:27:51 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:51 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255" returned: 0 in 0.480s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:51 devstack sudo[89036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255
Feb 28 01:27:51 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:51 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-7ddbf714-09be-4613-b8e6-8d8365cbf26b" returned: 0 in 0.404s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Lock "cinder-quobyte-7ddbf714-09be-4613-b8e6-8d8365cbf26b" released by "delete_volume" :: held 0.897s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Created reservations ['0055c2ca-1200-4b9b-a195-ae14de00d40e', 'b0659623-33eb-434e-b7dc-1e640dfd22aa', '684edb26-dc42-4258-aab9-454ba3b8c138', 'f949e25c-d4e6-457b-803e-0556d1e96b0b'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:51 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dab0969f-c043-4e97-816b-69525a474255" returned: 0 in 0.397s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-quobyte-dab0969f-c043-4e97-816b-69525a474255" released by "delete_volume" :: held 0.902s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:51 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:51 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Created reservations ['381b3f50-3d62-4bec-8064-d4f76e807a59', '1f8c4d2a-174a-46c3-a570-77bc448161d4', 'b062b84e-8265-41bb-9bf2-01265e58e0b1', '52f6579c-95b0-4a5b-b4c2-0dc4a555611e'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:51 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:51 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "cinder-aebc3e97-63a7-444f-9e99-bbb577b710c6-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-aebc3e97-63a7-444f-9e99-bbb577b710c6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "cinder-quobyte-aebc3e97-63a7-444f-9e99-bbb577b710c6" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-quobyte-aebc3e97-63a7-444f-9e99-bbb577b710c6" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5052913-8278-4d82-8135-f63e8d53dfbf]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:51 devstack sudo[89045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6
Feb 28 01:27:51 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:52 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:52 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Deleted volume successfully.
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-79fb26a5-0b5d-4d3e-943b-a0c80c7f1b3f tempest-VolumesListAdminTestJSON-1568956775 None] Lock "cinder-7ddbf714-09be-4613-b8e6-8d8365cbf26b-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:52 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.443s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:52 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Deleted volume successfully.
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8d54f478-546e-4e7f-9d30-bfbb0635b688 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-dab0969f-c043-4e97-816b-69525a474255-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:52 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6" returned: 0 in 0.496s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:52 devstack sudo[89052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6
Feb 28 01:27:52 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:52 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-aebc3e97-63a7-444f-9e99-bbb577b710c6" returned: 0 in 0.399s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-quobyte-aebc3e97-63a7-444f-9e99-bbb577b710c6" released by "delete_volume" :: held 0.915s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Created reservations ['85066b2c-7d7c-4f77-9c70-55e238e3d94b', 'dfa5b674-f544-42de-af02-9b87843401f3', '9f731ff2-93fe-4dd2-989c-5df395d36dcb', '8722bbe4-a994-4f1c-8368-c4bdf50485f3'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:52 devstack sudo[89055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:52 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "cinder-a26fcfbd-9b41-49a2-adbd-afed08211908-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-a26fcfbd-9b41-49a2-adbd-afed08211908-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "cinder-quobyte-a26fcfbd-9b41-49a2-adbd-afed08211908" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-quobyte-a26fcfbd-9b41-49a2-adbd-afed08211908" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f310c97-9844-4bf5-8eb9-581155cb71ea]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:53 devstack sudo[89057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908
Feb 28 01:27:53 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:53 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.426s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:53 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Deleted volume successfully.
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-cda17712-3f2c-4a6c-b7a6-f1368225cad1 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-aebc3e97-63a7-444f-9e99-bbb577b710c6-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:53 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908" returned: 0 in 0.468s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:53 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908
Feb 28 01:27:53 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:53 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a26fcfbd-9b41-49a2-adbd-afed08211908" returned: 0 in 0.394s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-quobyte-a26fcfbd-9b41-49a2-adbd-afed08211908" released by "delete_volume" :: held 0.882s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Created reservations ['04968be7-a467-4b31-b6b7-ce61a39f45cc', '7b8aedc1-5eac-4979-98bd-6bad5f8e0eb5', 'e2d04fc9-3f25-4bf9-83d0-affa2b422aaf', '4e539f1d-96f3-40d3-a4e3-a7bded15963d'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:53 devstack sudo[89066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:53 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:54 devstack sudo[89068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:54 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:54 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.427s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:54 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Deleted volume successfully.
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-a45b5d04-a16b-42ed-8aac-fbc95dc9ded5 tempest-VolumesListAdminTestJSON-745569985 None] Lock "cinder-a26fcfbd-9b41-49a2-adbd-afed08211908-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:54 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:54 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Flow 'volume_create_manager' (92c96781-cd9b-4dac-91ec-9b87cb765a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d9bc77-79d2-43f4-85f5-f82b6fe5da79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d9bc77-79d2-43f4-85f5-f82b6fe5da79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1851405400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc7ef35-3460-437d-976c-4b7ac2ddded7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab7b9a765134da5bc50dbb513846237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:56Z,use_quota=True,user_id='b13358c538b543479e41beb78a11ecb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d8706f-817d-436c-884a-3762d8b85d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d8706f-817d-436c-884a-3762d8b85d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5a535c-938b-4618-91f3-e1c3d29018e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5a535c-938b-4618-91f3-e1c3d29018e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc7ef35-3460-437d-976c-4b7ac2ddded7', 'volume_name': 'volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da60dc41-c43a-4201-8e2a-0b98f2356b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da60dc41-c43a-4201-8e2a-0b98f2356b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa6e4fe-44ed-4e9c-a141-149b6be2898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:56 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Volume 6fc7ef35-3460-437d-976c-4b7ac2ddded7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7', 'volume_size': 1}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1851405400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc7ef35-3460-437d-976c-4b7ac2ddded7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab7b9a765134da5bc50dbb513846237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:27:56Z,use_quota=True,user_id='b13358c538b543479e41beb78a11ecb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Creating volume 6fc7ef35-3460-437d-976c-4b7ac2ddded7 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:27:56 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:56 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7 1073741824
Feb 28 01:27:56 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:56 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7 1073741824" returned: 0 in 0.461s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:56 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7
Feb 28 01:27:56 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:57 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7" returned: 0 in 0.386s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa6e4fe-44ed-4e9c-a141-149b6be2898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e2f019-586b-4dfd-a9d3-bfda067b88a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:27:57 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Volume volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7 (6fc7ef35-3460-437d-976c-4b7ac2ddded7): created successfully
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e2f019-586b-4dfd-a9d3-bfda067b88a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Flow 'volume_create_manager' (92c96781-cd9b-4dac-91ec-9b87cb765a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:27:57 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c51238c4-4f15-4ecc-9302-16f3dac2fa06 tempest-VolumesMetadataTest-1505463513 None] Created volume successfully.
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Acquiring lock "cinder-6fc7ef35-3460-437d-976c-4b7ac2ddded7-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Lock "cinder-6fc7ef35-3460-437d-976c-4b7ac2ddded7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Acquiring lock "cinder-quobyte-6fc7ef35-3460-437d-976c-4b7ac2ddded7" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Lock "cinder-quobyte-6fc7ef35-3460-437d-976c-4b7ac2ddded7" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[527c63be-a58a-4f6d-818d-19ec9549e8f2]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:27:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:58 devstack sudo[89082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7
Feb 28 01:27:58 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:58 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7" returned: 0 in 0.455s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:58 devstack sudo[89087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7
Feb 28 01:27:58 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:58 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6fc7ef35-3460-437d-976c-4b7ac2ddded7" returned: 0 in 0.386s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Lock "cinder-quobyte-6fc7ef35-3460-437d-976c-4b7ac2ddded7" released by "delete_volume" :: held 0.863s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Created reservations ['af29a80a-6623-4b11-8a9c-5ec6c33b5d96', '400b55f1-c790-4dc0-a6f8-8e71dc6d5520', '7d81cf86-bc4c-41f5-90ca-8917e48af21c', '868cfa38-211e-470d-b5b4-04d872bc2d75'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:27:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:27:58 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:27:58 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:27:59 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Feb 28 01:27:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.448s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:27:59 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:27:59 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Deleted volume successfully.
Feb 28 01:27:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e7d34c0-95e4-42a3-a4e1-8b18931adf5b tempest-VolumesMetadataTest-1505463513 None] Lock "cinder-6fc7ef35-3460-437d-976c-4b7ac2ddded7-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Flow 'volume_create_manager' (51f52f81-e681-42d2-93cf-be2d683b6414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97567014-6ef1-472c-8e53-15bc08f42759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97567014-6ef1-472c-8e53-15bc08f42759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-683017323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea87136c-5c23-4472-bb85-db9a326e3d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd4f19c4809486b8ee4ac24616acb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:28:06Z,use_quota=True,user_id='ac35012f2b1548df99df747cef1ae3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645d2368-b229-4520-9be6-33255ea6fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645d2368-b229-4520-9be6-33255ea6fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa11228-9f09-4cdc-893c-6e9a00463985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa11228-9f09-4cdc-893c-6e9a00463985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea87136c-5c23-4472-bb85-db9a326e3d97', 'volume_name': 'volume-ea87136c-5c23-4472-bb85-db9a326e3d97', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e26801-9fab-4cd6-9993-1914a3e8f4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e26801-9fab-4cd6-9993-1914a3e8f4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4236269-023a-446a-a2ad-9439cdd9f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:28:05 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Volume ea87136c-5c23-4472-bb85-db9a326e3d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea87136c-5c23-4472-bb85-db9a326e3d97', 'volume_size': 1}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-683017323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea87136c-5c23-4472-bb85-db9a326e3d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd4f19c4809486b8ee4ac24616acb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:28:06Z,use_quota=True,user_id='ac35012f2b1548df99df747cef1ae3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Creating volume ea87136c-5c23-4472-bb85-db9a326e3d97 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:28:05 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:28:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:28:05 devstack sudo[89094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 1073741824
Feb 28 01:28:05 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:28:06 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root
Feb 28 01:28:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 1073741824" returned: 0 in 0.456s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:28:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:28:06 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97
Feb 28 01:28:06 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:28:06 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Feb 28 01:28:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97" returned: 0 in 0.401s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:28:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:28:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:28:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4236269-023a-446a-a2ad-9439cdd9f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea87136c-5c23-4472-bb85-db9a326e3d97', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:28:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51d440f-294b-447b-9791-d4c24df2e6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:28:06 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Volume volume-ea87136c-5c23-4472-bb85-db9a326e3d97 (ea87136c-5c23-4472-bb85-db9a326e3d97): created successfully
Feb 28 01:28:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51d440f-294b-447b-9791-d4c24df2e6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:28:06 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Flow 'volume_create_manager' (51f52f81-e681-42d2-93cf-be2d683b6414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:28:06 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4f7536ad-8414-441c-85f1-f9ca4d4110a5 tempest-VolumesActionsTest-1356060424 None] Created volume successfully.
Feb 28 01:28:16 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=40,cinder:INSERT=20,cinder:UPDATE=70,cinder:DELETE=6 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:28:16 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=49,cinder:INSERT=14,cinder:UPDATE=73,cinder:DELETE=6 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:28:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-df813fe5-1c5a-4c7c-829c-adc6c96d6e43 tempest-VolumesActionsTest-1356060424 None] Acquiring lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97" by "attach_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:28:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-df813fe5-1c5a-4c7c-829c-adc6c96d6e43 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97" acquired by "attach_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:28:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-df813fe5-1c5a-4c7c-829c-adc6c96d6e43 tempest-VolumesActionsTest-1356060424 None] Attaching volume ea87136c-5c23-4472-bb85-db9a326e3d97 to instance faf7778c-d951-4e9d-97a2-df8a77b74a68 at mountpoint /dev/vdb on host None.
Feb 28 01:28:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-df813fe5-1c5a-4c7c-829c-adc6c96d6e43 tempest-VolumesActionsTest-1356060424 None] Attach volume completed successfully.
Feb 28 01:28:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-df813fe5-1c5a-4c7c-829c-adc6c96d6e43 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97" released by "attach_volume" :: held 0.054s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:28:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5ac4eec5-f9d6-4337-bf5d-68f03528f1b9 tempest-VolumesActionsTest-1356060424 None] Acquiring lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97-detach_volume" by "detach_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:28:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5ac4eec5-f9d6-4337-bf5d-68f03528f1b9 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97-detach_volume" acquired by "detach_volume" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:28:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5ac4eec5-f9d6-4337-bf5d-68f03528f1b9 tempest-VolumesActionsTest-1356060424 None] Detaching volume ea87136c-5c23-4472-bb85-db9a326e3d97 from instance faf7778c-d951-4e9d-97a2-df8a77b74a68.
Feb 28 01:28:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5ac4eec5-f9d6-4337-bf5d-68f03528f1b9 tempest-VolumesActionsTest-1356060424 None] Detach volume completed successfully.
Feb 28 01:28:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5ac4eec5-f9d6-4337-bf5d-68f03528f1b9 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:28:40 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:INSERT=1,cinder:SELECT=7,cinder:UPDATE=4 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:28:40 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:28:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b6afc8d0-955e-44cb-b348-e59072d82ed0 tempest-VolumesActionsTest-1356060424 None] Acquiring lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97" by "attach_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:28:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b6afc8d0-955e-44cb-b348-e59072d82ed0 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97" acquired by "attach_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:28:41 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b6afc8d0-955e-44cb-b348-e59072d82ed0 tempest-VolumesActionsTest-1356060424 None] Attaching volume ea87136c-5c23-4472-bb85-db9a326e3d97 to instance 62650671-8e7b-49de-b11c-dee970512b5b at mountpoint /dev/vdb on host None.
Feb 28 01:28:41 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b6afc8d0-955e-44cb-b348-e59072d82ed0 tempest-VolumesActionsTest-1356060424 None] Attach volume completed successfully.
Feb 28 01:28:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b6afc8d0-955e-44cb-b348-e59072d82ed0 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97" released by "attach_volume" :: held 0.053s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:28:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4b774e87-5c7e-4b2b-ac24-a3ebe29b7097 tempest-VolumesActionsTest-1356060424 None] Acquiring lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97-detach_volume" by "detach_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:28:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4b774e87-5c7e-4b2b-ac24-a3ebe29b7097 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:28:41 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4b774e87-5c7e-4b2b-ac24-a3ebe29b7097 tempest-VolumesActionsTest-1356060424 None] Detaching volume ea87136c-5c23-4472-bb85-db9a326e3d97 from instance 62650671-8e7b-49de-b11c-dee970512b5b.
Feb 28 01:28:41 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4b774e87-5c7e-4b2b-ac24-a3ebe29b7097 tempest-VolumesActionsTest-1356060424 None] Detach volume completed successfully.
Feb 28 01:28:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4b774e87-5c7e-4b2b-ac24-a3ebe29b7097 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:28:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:28:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:28:49 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e02b55-5e74-477f-aa97-5127f4086ac8]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:28:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:28:49 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97
Feb 28 01:28:49 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:28:49 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Feb 28 01:28:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97" returned: 0 in 0.461s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:28:49 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e6d127-e012-45e8-912f-c8691718962a]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:28:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:28:49 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97
Feb 28 01:28:49 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:28:50 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Feb 28 01:28:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97" returned: 0 in 0.451s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:28:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.b50641aa-7a2d-4198-b0ef-09d1388db1eeb3ewuj7j.img {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:28:50 devstack sudo[89309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.b50641aa-7a2d-4198-b0ef-09d1388db1eeb3ewuj7j.img
Feb 28 01:28:50 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:28:51 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:28:52 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root
Feb 28 01:28:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.b50641aa-7a2d-4198-b0ef-09d1388db1eeb3ewuj7j.img" returned: 0 in 1.765s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:28:52 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc70bc7d-34c2-4fdf-9ce4-7844cef4dc05]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:28:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:28:52 devstack sudo[89322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97
Feb 28 01:28:52 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:28:52 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root
Feb 28 01:28:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97" returned: 0 in 0.581s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:28:52 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97, size 1024.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.b50641aa-7a2d-4198-b0ef-09d1388db1eeb3ewuj7j.img {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:28:52 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Converted 1024.00 MB image at 579.96 MB/s
Feb 28 01:28:52 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] b50641aa-7a2d-4198-b0ef-09d1388db1ee was raw, no need to convert to raw {{(pid=82470) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Feb 28 01:28:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:28:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:28:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:28:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:28:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:28:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:28:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:28:54 devstack sudo[89327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:28:54 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:28:54 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root
Feb 28 01:28:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.410s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:28:54 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:28:59 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:INSERT=1,cinder:SELECT=7,cinder:UPDATE=3 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:29:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.808s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Uploaded volume to glance image-id: b50641aa-7a2d-4198-b0ef-09d1388db1ee. {{(pid=82470) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Feb 28 01:29:02 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-46a801e5-9b01-4da3-9555-56d2b7a030fe tempest-VolumesActionsTest-1356060424 None] Copy volume to image completed successfully.
Feb 28 01:29:02 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=2 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:29:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1f135e-7d9e-466d-909f-a3958586ed20]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:03 devstack sudo[89333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97
Feb 28 01:29:03 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:03 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97" returned: 0 in 0.445s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9f1a51-3c96-4839-9cfe-4b5eaeb5c45b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:03 devstack sudo[89338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97
Feb 28 01:29:03 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:04 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:04 devstack sudo[89343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img
Feb 28 01:29:04 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:05 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img" returned: 0 in 1.717s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:05 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e2aab7-ed45-4cd7-8dcd-dac623381415]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:05 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97
Feb 28 01:29:05 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:06 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97" returned: 0 in 0.571s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:06 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97, size 1024.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:29:06 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Converted 1024.00 MB image at 596.07 MB/s
Feb 28 01:29:06 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] a6fd172a-d1a0-4504-97bc-58b135cefe39 was raw, converting to qcow2 {{(pid=82470) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Feb 28 01:29:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5a6731-d981-4f4c-89d3-c578d4849117]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:06 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img
Feb 28 01:29:06 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:06 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:07 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img
Feb 28 01:29:07 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:07 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img" returned: 1 in 0.458s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:29:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img /opt/stack/data/cinder/conversion/vol_upload_pjm7kry6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:07 devstack sudo[89369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img /opt/stack/data/cinder/conversion/vol_upload_pjm7kry6
Feb 28 01:29:07 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:07 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img /opt/stack/data/cinder/conversion/vol_upload_pjm7kry6" returned: 0 in 0.403s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:07 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Image conversion details: src /opt/stack/data/cinder/conversion/ea87136c-5c23-4472-bb85-db9a326e3d97.temp_image.a6fd172a-d1a0-4504-97bc-58b135cefe39c_bpnk4w.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pjm7kry6 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:29:07 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Converted 1024.00 MB image at 1024.00 MB/s
Feb 28 01:29:07 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bc80c9-f787-4085-97f3-2fc8d7684504]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pjm7kry6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:07 devstack sudo[89374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pjm7kry6
Feb 28 01:29:07 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:08 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pjm7kry6" returned: 0 in 0.438s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 5.761s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Uploaded volume to glance image-id: a6fd172a-d1a0-4504-97bc-58b135cefe39. {{(pid=82470) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Feb 28 01:29:09 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-964be0a2-1255-4e23-a8df-5234e1258b59 tempest-VolumesActionsTest-1356060424 None] Copy volume to image completed successfully.
Feb 28 01:29:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Acquiring lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Acquiring lock "cinder-quobyte-ea87136c-5c23-4472-bb85-db9a326e3d97" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-quobyte-ea87136c-5c23-4472-bb85-db9a326e3d97" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:09 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9408c3-ec6e-4453-8ff9-ab81b62d4d59]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:09 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97
Feb 28 01:29:09 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:10 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97" returned: 0 in 0.451s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:10 devstack sudo[89384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97
Feb 28 01:29:10 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:10 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ea87136c-5c23-4472-bb85-db9a326e3d97" returned: 0 in 0.381s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-quobyte-ea87136c-5c23-4472-bb85-db9a326e3d97" released by "delete_volume" :: held 0.852s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Created reservations ['daa58c70-04bd-4b25-bfe6-b3aa413c360d', '63ba723c-85ba-4f4c-b99c-c971095920b1', 'e0c9e3d4-10ac-48e5-ba1a-96d8a3e6b881', '4cf58c5b-f707-407a-94a3-f67ee1ff5220'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:10 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:10 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:11 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.391s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:11 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:11 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Deleted volume successfully.
Feb 28 01:29:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-dd966eae-0b8e-4b9e-af93-45a4335397e7 tempest-VolumesActionsTest-1356060424 None] Lock "cinder-ea87136c-5c23-4472-bb85-db9a326e3d97-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (b2549245-a800-4872-a417-dd883d2e9f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36c30c5-7e80-44b0-a95f-9bf45704c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36c30c5-7e80-44b0-a95f-9bf45704c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-571520457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6558d50b-1fc7-47b3-831d-038856807b25,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:14Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b9bdf0-33af-4dac-8d8c-d190508d7ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b9bdf0-33af-4dac-8d8c-d190508d7ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7857f3df-5ff7-4cef-8ec8-bb4edba5d6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7857f3df-5ff7-4cef-8ec8-bb4edba5d6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6558d50b-1fc7-47b3-831d-038856807b25', 'volume_name': 'volume-6558d50b-1fc7-47b3-831d-038856807b25', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95102258-ad11-47f2-ac7b-ce5fcba69415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95102258-ad11-47f2-ac7b-ce5fcba69415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a3ba81-bd4d-4ac3-92ff-0d0427fc2ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:14 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Volume 6558d50b-1fc7-47b3-831d-038856807b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6558d50b-1fc7-47b3-831d-038856807b25', 'volume_size': 1}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-571520457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6558d50b-1fc7-47b3-831d-038856807b25,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:14Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Creating volume 6558d50b-1fc7-47b3-831d-038856807b25 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:14 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:14 devstack sudo[89393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25 1073741824
Feb 28 01:29:14 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:14 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25 1073741824" returned: 0 in 0.454s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:15 devstack sudo[89398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25
Feb 28 01:29:15 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:15 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25" returned: 0 in 0.396s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a3ba81-bd4d-4ac3-92ff-0d0427fc2ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6558d50b-1fc7-47b3-831d-038856807b25', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012ff17b-1874-4728-b6bc-cc24d5bdb1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:15 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Volume volume-6558d50b-1fc7-47b3-831d-038856807b25 (6558d50b-1fc7-47b3-831d-038856807b25): created successfully
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012ff17b-1874-4728-b6bc-cc24d5bdb1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (b2549245-a800-4872-a417-dd883d2e9f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:15 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-cd79617e-2958-4b1b-b3d1-552ca78688e1 tempest-VolumesGetTest-1257816987 None] Created volume successfully.
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (ef0c8e3b-2456-4266-872d-b5f610804204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc45d02-66af-4da4-b419-4c4343a694b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc45d02-66af-4da4-b419-4c4343a694b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-402041506',display_name='tempest-VolumesGetTest-Volume-920914293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f0f17a-57e1-4331-a81b-e8ad34db9b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:16Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc196bb3-1bf8-446b-9feb-a573122b5573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc196bb3-1bf8-446b-9feb-a573122b5573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ad46f0-048a-4f26-b89e-fe1d5e278442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ad46f0-048a-4f26-b89e-fe1d5e278442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f0f17a-57e1-4331-a81b-e8ad34db9b6a', 'volume_name': 'volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c311ec96-b730-436a-96c3-e95b89910f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c311ec96-b730-436a-96c3-e95b89910f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed66dc8-7d54-4449-8fef-67ab808d3852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:15 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Volume c3f0f17a-57e1-4331-a81b-e8ad34db9b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a', 'volume_size': 1}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-402041506',display_name='tempest-VolumesGetTest-Volume-920914293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f0f17a-57e1-4331-a81b-e8ad34db9b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:16Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Creating volume c3f0f17a-57e1-4331-a81b-e8ad34db9b6a {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:15 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:15 devstack sudo[89401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a 1073741824
Feb 28 01:29:15 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:16 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a 1073741824" returned: 0 in 0.447s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:16 devstack sudo[89406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a
Feb 28 01:29:16 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:16 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a" returned: 0 in 0.397s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed66dc8-7d54-4449-8fef-67ab808d3852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de74ec24-00bd-4071-8c1c-0bce9eaee043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:16 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Volume volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a (c3f0f17a-57e1-4331-a81b-e8ad34db9b6a): created successfully
Feb 28 01:29:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de74ec24-00bd-4071-8c1c-0bce9eaee043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (ef0c8e3b-2456-4266-872d-b5f610804204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:16 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-a38faa72-01d6-4f3d-9c13-3c47ffcdf49a tempest-VolumesGetTest-1257816987 None] Created volume successfully.
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Lock "cinder-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-quobyte-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a" acquired by "delete_volume" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4d6a9a-4f7f-4679-8958-a2298545ae94]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:17 devstack sudo[89409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a
Feb 28 01:29:17 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:17 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a" returned: 0 in 0.456s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:17 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a
Feb 28 01:29:17 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:17 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a" returned: 0 in 0.390s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a" released by "delete_volume" :: held 0.876s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:17 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Created reservations ['33a58af4-ea1a-409e-b907-fe41804d3b99', '7d04f454-0562-4297-ba3e-f67aaa0d1d23', '7dc9c49c-00fa-46dd-92d7-4e6f08188c0c', '042c884e-5cde-4ca5-b9df-64655234df22'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:18 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:18 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-6558d50b-1fc7-47b3-831d-038856807b25-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Lock "cinder-6558d50b-1fc7-47b3-831d-038856807b25-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-quobyte-6558d50b-1fc7-47b3-831d-038856807b25" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-6558d50b-1fc7-47b3-831d-038856807b25" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed9da62-c5cd-4f62-bebc-ba7459e9d8da]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:18 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25
Feb 28 01:29:18 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:18 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.420s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:18 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Deleted volume successfully.
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1bcdabbf-c62c-465b-88fa-cc796553bfbf tempest-VolumesGetTest-1257816987 None] Lock "cinder-c3f0f17a-57e1-4331-a81b-e8ad34db9b6a-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:18 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25" returned: 0 in 0.473s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:18 devstack sudo[89425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25
Feb 28 01:29:18 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:19 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6558d50b-1fc7-47b3-831d-038856807b25" returned: 0 in 0.392s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-6558d50b-1fc7-47b3-831d-038856807b25" released by "delete_volume" :: held 0.890s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Created reservations ['49aecb87-eb62-4ad8-ab5b-390ed0b56380', '861f3e6b-3fd5-418a-9397-1b9bc5bb8d5d', 'f260340a-2887-46f6-aca1-092bb56a73fd', '4ac98f1c-de10-4116-910f-438112816422'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:19 devstack sudo[89428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:19 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (28d1eb11-c50c-49f2-8350-f077af210ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b290664-f098-49ec-913b-c8df448892de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b290664-f098-49ec-913b-c8df448892de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-840749802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735eb3f4-524e-4e32-95f8-10e7d1635a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:20Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e6ae75-adfa-41bc-922f-f02417ce8059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e6ae75-adfa-41bc-922f-f02417ce8059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76798f0b-64c5-41d9-86ce-05f0bb79ad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76798f0b-64c5-41d9-86ce-05f0bb79ad01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735eb3f4-524e-4e32-95f8-10e7d1635a6d', 'volume_name': 'volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c108a39-6ab3-4d2f-b080-bf51402a0414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c108a39-6ab3-4d2f-b080-bf51402a0414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544eb2dc-164c-476c-9dc8-ead99b2fdb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:19 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Volume 735eb3f4-524e-4e32-95f8-10e7d1635a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d', 'volume_size': 1}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-840749802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735eb3f4-524e-4e32-95f8-10e7d1635a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:20Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Creating volume 735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:19 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:19 devstack sudo[89431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d 1073741824
Feb 28 01:29:19 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:19 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.416s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:19 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Deleted volume successfully.
Feb 28 01:29:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-489f12b1-e5ed-4d80-b7ff-29c4ff16f697 tempest-VolumesGetTest-1257816987 None] Lock "cinder-6558d50b-1fc7-47b3-831d-038856807b25-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:20 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d 1073741824" returned: 0 in 0.455s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:20 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d
Feb 28 01:29:20 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:20 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d" returned: 0 in 0.384s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544eb2dc-164c-476c-9dc8-ead99b2fdb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e18abc-90ae-414e-92f1-59661722c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:20 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Volume volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d (735eb3f4-524e-4e32-95f8-10e7d1635a6d): created successfully
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e18abc-90ae-414e-92f1-59661722c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (28d1eb11-c50c-49f2-8350-f077af210ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-a14e73f6-300d-486e-be9d-0676cdb67c40 tempest-VolumesGetTest-1257816987 None] Created volume successfully.
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (c0a63b51-3221-4454-90da-bc360ea703bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ce1297-670f-405d-8f0b-69cea9b926f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ce1297-670f-405d-8f0b-69cea9b926f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1459099057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fdcd60-d786-4d7d-b817-9a8660174dbe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=735eb3f4-524e-4e32-95f8-10e7d1635a6d,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:21Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de3740c-cbb2-45cf-8c55-a7d54e5bdcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de3740c-cbb2-45cf-8c55-a7d54e5bdcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a0fa93-4118-4b73-b715-9e2421b96242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a0fa93-4118-4b73-b715-9e2421b96242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c5fdcd60-d786-4d7d-b817-9a8660174dbe', 'volume_name': 'volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe', 'volume_size': 1, 'source_volid': '735eb3f4-524e-4e32-95f8-10e7d1635a6d', 'source_volstatus': 'available'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a2693e-ae9a-474d-b884-74efcfb59058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a2693e-ae9a-474d-b884-74efcfb59058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd45a3e-5871-411c-9f2a-6618f8430ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:20 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Volume c5fdcd60-d786-4d7d-b817-9a8660174dbe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe', 'volume_size': 1, 'source_volid': '735eb3f4-524e-4e32-95f8-10e7d1635a6d', 'source_volstatus': 'available'}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:20 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Cloning volume 735eb3f4-524e-4e32-95f8-10e7d1635a6d to volume c5fdcd60-d786-4d7d-b817-9a8660174dbe
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Creating offline snapshot e3434332-dabd-4198-bb31-ad8d6aeb33a9 of volume 735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[11095eb3-3286-466f-9b01-04bc79e7402d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:20 devstack sudo[89439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d
Feb 28 01:29:20 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:21 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d" returned: 0 in 0.464s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:21 devstack sudo[89444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 1G
Feb 28 01:29:21 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:21 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 1G" returned: 0 in 0.464s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:21 devstack sudo[89450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9
Feb 28 01:29:21 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:22 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9" returned: 0 in 0.403s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:22 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 is being set with open permissions: ugo+rw
Feb 28 01:29:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:22 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9
Feb 28 01:29:22 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:22 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9" returned: 0 in 0.389s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:22 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.info
Feb 28 01:29:22 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:23 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.info" returned: 0 in 0.402s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:23 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.info is being set with open permissions: ugo+rw
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:23 devstack sudo[89461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.info
Feb 28 01:29:23 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:23 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.info" returned: 0 in 0.388s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-quobyte-c5fdcd60-d786-4d7d-b817-9a8660174dbe" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-c5fdcd60-d786-4d7d-b817-9a8660174dbe" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] snapshot: e3434332-dabd-4198-bb31-ad8d6aeb33a9, volume: c5fdcd60-d786-4d7d-b817-9a8660174dbe,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f94e97-fdd3-49db-8e13-10e7353ab9b9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:23 devstack sudo[89464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9
Feb 28 01:29:23 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:23 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9" returned: 0 in 0.463s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[26667860-f532-4bd5-bfb1-dddb7ad67618]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:24 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d
Feb 28 01:29:24 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:24 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d" returned: 0 in 0.461s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:24 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:29:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:24 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe
Feb 28 01:29:24 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:26 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe" returned: 0 in 1.877s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:26 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6500e7-568b-42f6-a96d-d8aa9dc438d9]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:26 devstack sudo[89486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d
Feb 28 01:29:26 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:26 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d" returned: 0 in 0.595s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:26 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d, size 1024.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:29:26 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Converted 1024.00 MB image at 545.30 MB/s
Feb 28 01:29:26 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe is being set with open permissions: ugo+rw
Feb 28 01:29:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:26 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe
Feb 28 01:29:26 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:27 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe" returned: 0 in 0.388s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-c5fdcd60-d786-4d7d-b817-9a8660174dbe" released by "_copy_volume_from_snapshot" :: held 3.827s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-quobyte-e3434332-dabd-4198-bb31-ad8d6aeb33a9" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-e3434332-dabd-4198-bb31-ad8d6aeb33a9" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Deleting offline snapshot e3434332-dabd-4198-bb31-ad8d6aeb33a9 of volume 735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] snapshot_file for this snap is: volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e47546-3489-407a-ba82-affab8f8a541]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:27 devstack sudo[89494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9
Feb 28 01:29:27 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:27 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9" returned: 0 in 0.446s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b15db60-605d-4261-ac3a-0be951a027e5]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:27 devstack sudo[89499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d
Feb 28 01:29:27 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:28 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d" returned: 0 in 0.454s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:28 devstack sudo[89504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9
Feb 28 01:29:28 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:28 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9" returned: 0 in 0.430s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:28 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9
Feb 28 01:29:28 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:29 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d.e3434332-dabd-4198-bb31-ad8d6aeb33a9" returned: 0 in 0.387s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-e3434332-dabd-4198-bb31-ad8d6aeb33a9" released by "_delete_snapshot" :: held 1.757s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.199s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd45a3e-5871-411c-9f2a-6618f8430ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe', 'volume_size': 1, 'source_volid': '735eb3f4-524e-4e32-95f8-10e7d1635a6d', 'source_volstatus': 'available'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e574ce-2111-4bdf-a5c9-03c1cb2857e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:29 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Volume volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe (c5fdcd60-d786-4d7d-b817-9a8660174dbe): created successfully
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e574ce-2111-4bdf-a5c9-03c1cb2857e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (c0a63b51-3221-4454-90da-bc360ea703bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:29 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3e6e2d75-2173-44ce-9469-89397d2778a9 tempest-VolumesGetTest-1257816987 None] Created volume successfully.
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (89be8faf-643e-43e6-89f6-29fb8ce72e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d046f220-27c3-4b6b-83c9-f0e102144cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d046f220-27c3-4b6b-83c9-f0e102144cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2114006377',display_name='tempest-VolumesGetTest-Volume-939314564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6273fe-7a90-4519-8af2-ad7cd791184d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:30Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d9f9ea-f90a-4930-bf6a-a75b1aad2e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d9f9ea-f90a-4930-bf6a-a75b1aad2e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec6ddac-d9f0-4331-8535-ab099d64f949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec6ddac-d9f0-4331-8535-ab099d64f949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6273fe-7a90-4519-8af2-ad7cd791184d', 'volume_name': 'volume-cb6273fe-7a90-4519-8af2-ad7cd791184d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76644b41-8076-461b-bf5b-aaaa4489d395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76644b41-8076-461b-bf5b-aaaa4489d395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7413efd-01e0-4771-b5bb-be917122eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:29 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Volume cb6273fe-7a90-4519-8af2-ad7cd791184d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6273fe-7a90-4519-8af2-ad7cd791184d', 'volume_size': 1}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2114006377',display_name='tempest-VolumesGetTest-Volume-939314564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6273fe-7a90-4519-8af2-ad7cd791184d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:30Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Creating volume cb6273fe-7a90-4519-8af2-ad7cd791184d {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:29 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:29 devstack sudo[89512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d 1073741824
Feb 28 01:29:29 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:30 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d 1073741824" returned: 0 in 0.454s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:30 devstack sudo[89517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d
Feb 28 01:29:30 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:30 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d" returned: 0 in 0.390s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7413efd-01e0-4771-b5bb-be917122eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6273fe-7a90-4519-8af2-ad7cd791184d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a2dce5-3643-4640-bc22-6adc7252452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:30 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Volume volume-cb6273fe-7a90-4519-8af2-ad7cd791184d (cb6273fe-7a90-4519-8af2-ad7cd791184d): created successfully
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a2dce5-3643-4640-bc22-6adc7252452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (89be8faf-643e-43e6-89f6-29fb8ce72e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:30 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-61b8d82f-c5be-440b-9280-edb60c1eff6a tempest-VolumesGetTest-1257816987 None] Created volume successfully.
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-cb6273fe-7a90-4519-8af2-ad7cd791184d-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Lock "cinder-cb6273fe-7a90-4519-8af2-ad7cd791184d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-quobyte-cb6273fe-7a90-4519-8af2-ad7cd791184d" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-cb6273fe-7a90-4519-8af2-ad7cd791184d" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e5a040-0197-4d5d-a298-5be6f4403ab0]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:31 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d
Feb 28 01:29:31 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:31 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d" returned: 0 in 0.448s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:31 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d
Feb 28 01:29:31 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:31 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cb6273fe-7a90-4519-8af2-ad7cd791184d" returned: 0 in 0.406s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-cb6273fe-7a90-4519-8af2-ad7cd791184d" released by "delete_volume" :: held 0.883s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Created reservations ['ee2fcbf8-81e3-4b1f-b09c-48ed5c6e50d8', 'd660e45d-e885-42c6-b357-523a34dc5d5f', 'fa327b8b-f515-4fc3-8eaa-c33dde21bb08', 'baa32b17-6b2e-4a26-8d4c-f9951b4d05a1'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:31 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:31 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-c5fdcd60-d786-4d7d-b817-9a8660174dbe-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Lock "cinder-c5fdcd60-d786-4d7d-b817-9a8660174dbe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-quobyte-c5fdcd60-d786-4d7d-b817-9a8660174dbe" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-c5fdcd60-d786-4d7d-b817-9a8660174dbe" acquired by "delete_volume" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[649a6f5b-e27a-408a-9334-68031f3e9790]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:32 devstack sudo[89531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe
Feb 28 01:29:32 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:32 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.427s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:32 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Deleted volume successfully.
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3dc85774-f436-4d6b-8218-1c61becb742d tempest-VolumesGetTest-1257816987 None] Lock "cinder-cb6273fe-7a90-4519-8af2-ad7cd791184d-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:32 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:32 devstack sudo[89537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe
Feb 28 01:29:32 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:32 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c5fdcd60-d786-4d7d-b817-9a8660174dbe" returned: 0 in 0.394s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-c5fdcd60-d786-4d7d-b817-9a8660174dbe" released by "delete_volume" :: held 0.875s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Created reservations ['77df3e33-53d2-4ef9-afaf-c40b4c9106e3', '588382d1-663f-4a48-89bf-ce7b02940efd', 'dd244d98-994a-48d8-bb66-5158bfae59a9', 'eb758e65-0b89-4f16-933b-6d801e56f3f2'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:33 devstack sudo[89540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:33 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-735eb3f4-524e-4e32-95f8-10e7d1635a6d-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Lock "cinder-735eb3f4-524e-4e32-95f8-10e7d1635a6d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-quobyte-735eb3f4-524e-4e32-95f8-10e7d1635a6d" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-735eb3f4-524e-4e32-95f8-10e7d1635a6d" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd3d638-5081-4f62-879a-94df617051c1]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:33 devstack sudo[89542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d
Feb 28 01:29:33 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:33 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.438s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:33 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Deleted volume successfully.
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d1a83779-dc27-4d5a-93d3-11cdfd2f9b91 tempest-VolumesGetTest-1257816987 None] Lock "cinder-c5fdcd60-d786-4d7d-b817-9a8660174dbe-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:33 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d" returned: 0 in 0.473s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:33 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d
Feb 28 01:29:33 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:34 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-735eb3f4-524e-4e32-95f8-10e7d1635a6d" returned: 0 in 0.390s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-735eb3f4-524e-4e32-95f8-10e7d1635a6d" released by "delete_volume" :: held 0.888s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Created reservations ['8509ca3c-d8d2-42e6-88f3-2a2c3b3e4a11', 'dd874469-c76a-41b1-b33c-3e3d8fddb9f7', '4bce1aad-2424-479a-87c8-ffc0494edcb0', '9edc51f6-e40f-41d1-a0c4-d20297009d19'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:34 devstack sudo[89551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:34 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:34 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (4ddd56eb-f009-4428-9782-7e3d2fc84b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60d7789-b78e-4de3-a0e1-76636dd6cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.469s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:34 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Deleted volume successfully.
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60d7789-b78e-4de3-a0e1-76636dd6cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1428957011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96f5a89-163d-4949-a52a-09bc4305dc46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:35Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1152d405-ab62-4fc7-ab8b-0f043ec6eda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1152d405-ab62-4fc7-ab8b-0f043ec6eda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f167d91-1586-4386-af87-e4ffc29206a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.image.glance [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Creating Keystone auth plugin from conf {{(pid=82470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-026a2e7a-f274-4730-a1e0-63e6a5100eb6 tempest-VolumesGetTest-1257816987 None] Lock "cinder-735eb3f4-524e-4e32-95f8-10e7d1635a6d-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f167d91-1586-4386-af87-e4ffc29206a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b96f5a89-163d-4949-a52a-09bc4305dc46', 'volume_name': 'volume-b96f5a89-163d-4949-a52a-09bc4305dc46', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc636eef0>}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9075029b-3b18-456a-a9cc-6c7385582d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9075029b-3b18-456a-a9cc-6c7385582d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a154e55-6829-40bd-bcf5-7805c8ed569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:34 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Volume b96f5a89-163d-4949-a52a-09bc4305dc46: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b96f5a89-163d-4949-a52a-09bc4305dc46', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc636eef0>}
Feb 28 01:29:34 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Trying to clone b96f5a89-163d-4949-a52a-09bc4305dc46 from image 9351240e-6df5-4131-8ea1-feeaf12d9c21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]). {{(pid=82470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 28 01:29:35 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 28 01:29:35 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Image download 20.69 MB at 20.69 MB/s
Feb 28 01:29:35 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7af953-35f0-4b0f-a4bc-84794f8a112f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:35 devstack sudo[89555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD
Feb 28 01:29:35 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:35 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:35 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Temporary image 9351240e-6df5-4131-8ea1-feeaf12d9c21 is fetched for user 4b218dd1b10a4d93a8bee631747297f9. {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 28 01:29:35 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9451816a-71b4-4779-858b-b4a208e94e33]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:35 devstack sudo[89560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD
Feb 28 01:29:35 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:36 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1428957011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96f5a89-163d-4949-a52a-09bc4305dc46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:35Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Creating volume b96f5a89-163d-4949-a52a-09bc4305dc46 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:36 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:36 devstack sudo[89566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 1073741824
Feb 28 01:29:36 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:36 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 1073741824" returned: 0 in 0.451s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:36 devstack sudo[89571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46
Feb 28 01:29:36 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:36 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46" returned: 0 in 0.413s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:37 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Attempting download of 9351240e-6df5-4131-8ea1-feeaf12d9c21 ((None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}])) to volume b96f5a89-163d-4949-a52a-09bc4305dc46. {{(pid=82470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 28 01:29:37 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0680fc-6f7e-49c4-8531-eb90e1ee9a1b]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_71j3t63w {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:37 devstack sudo[89574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_71j3t63w
Feb 28 01:29:37 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:37 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_71j3t63w" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_71j3t63w {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:37 devstack sudo[89578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_71j3t63w
Feb 28 01:29:37 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:37 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_71j3t63w" returned: 1 in 0.470s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9351240e-6df5-4131-8ea1-feeaf12d9c21_71j3t63w' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:29:37 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d4caff-1e1c-4d5b-8260-9aa2cf1cf791]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:38 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD
Feb 28 01:29:38 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:38 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:38 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] 9351240e-6df5-4131-8ea1-feeaf12d9c21 was qcow2, converting to raw {{(pid=82470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 28 01:29:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:38 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46
Feb 28 01:29:38 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:39 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46" returned: 0 in 0.782s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:39 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9351240e-6df5-4131-8ea1-feeaf12d9c21_23i9tj7tdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:29:39 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Converted 112.00 MB image at 112.00 MB/s
Feb 28 01:29:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:39 devstack sudo[89597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 1G
Feb 28 01:29:39 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:39 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 1G" returned: 0 in 0.408s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:39 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69a0356-7bbd-4a55-9d9c-b25c052695dd]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:39 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46
Feb 28 01:29:39 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:40 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:40 devstack sudo[89646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46
Feb 28 01:29:40 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:40 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46" returned: 1 in 0.445s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Downloaded image 9351240e-6df5-4131-8ea1-feeaf12d9c21 ((None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}])) to volume b96f5a89-163d-4949-a52a-09bc4305dc46 successfully. {{(pid=82470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Temporary image 9351240e-6df5-4131-8ea1-feeaf12d9c21 for user 4b218dd1b10a4d93a8bee631747297f9 is deleted. {{(pid=82470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG cinder.volume.volume_utils [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Marking volume b96f5a89-163d-4949-a52a-09bc4305dc46 as bootable. {{(pid=82470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Copying metadata from image 9351240e-6df5-4131-8ea1-feeaf12d9c21 to b96f5a89-163d-4949-a52a-09bc4305dc46. {{(pid=82470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Creating volume glance metadata for volume b96f5a89-163d-4949-a52a-09bc4305dc46 backed by image 9351240e-6df5-4131-8ea1-feeaf12d9c21 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a154e55-6829-40bd-bcf5-7805c8ed569c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96f5a89-163d-4949-a52a-09bc4305dc46', 'volume_size': 1, 'image_id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9351240e-6df5-4131-8ea1-feeaf12d9c21', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22a862d1bd024ed0b532cced9308a3d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9351240e-6df5-4131-8ea1-feeaf12d9c21', 'created_at': datetime.datetime(2026, 2, 28, 0, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 28, 0, 16, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9351240e-6df5-4131-8ea1-feeaf12d9c21/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9fc636eef0>}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69aa065b-57c3-4de0-8348-6a8e376c6bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:40 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Volume volume-b96f5a89-163d-4949-a52a-09bc4305dc46 (b96f5a89-163d-4949-a52a-09bc4305dc46): created successfully
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69aa065b-57c3-4de0-8348-6a8e376c6bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:40 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (4ddd56eb-f009-4428-9782-7e3d2fc84b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:40 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-35beda99-cfe5-4f44-86d8-7c21132b59d3 tempest-VolumesGetTest-1257816987 None] Created volume successfully.
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (6225b55d-97db-48d8-bcaf-709f55d0550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04bbe52-66fa-4a6f-9293-5dbeb950940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04bbe52-66fa-4a6f-9293-5dbeb950940b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-234278770',display_name='tempest-VolumesGetTest-Volume-1277833006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1828745b-6b33-45da-a89d-05ae5b65c2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:41Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebbc60a-7182-4884-9ae4-2d9704acaad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebbc60a-7182-4884-9ae4-2d9704acaad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe8db7d-ff7e-4ca8-939a-e0659b64838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe8db7d-ff7e-4ca8-939a-e0659b64838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1828745b-6b33-45da-a89d-05ae5b65c2fe', 'volume_name': 'volume-1828745b-6b33-45da-a89d-05ae5b65c2fe', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6be846-91f2-42dc-890c-ee6b300483fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6be846-91f2-42dc-890c-ee6b300483fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1075ee7-21cd-4186-a566-b3cabf3781cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:41 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Volume 1828745b-6b33-45da-a89d-05ae5b65c2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1828745b-6b33-45da-a89d-05ae5b65c2fe', 'volume_size': 1}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-234278770',display_name='tempest-VolumesGetTest-Volume-1277833006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1828745b-6b33-45da-a89d-05ae5b65c2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f819eed49c8b4f3ab8490220081e09ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:41Z,use_quota=True,user_id='4b218dd1b10a4d93a8bee631747297f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Creating volume 1828745b-6b33-45da-a89d-05ae5b65c2fe {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:41 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:41 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe 1073741824
Feb 28 01:29:41 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:41 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe 1073741824" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:41 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe
Feb 28 01:29:41 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:42 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe" returned: 0 in 0.390s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1075ee7-21cd-4186-a566-b3cabf3781cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1828745b-6b33-45da-a89d-05ae5b65c2fe', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ee59ae-744c-419c-afe5-556c0a3adfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Volume volume-1828745b-6b33-45da-a89d-05ae5b65c2fe (1828745b-6b33-45da-a89d-05ae5b65c2fe): created successfully
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ee59ae-744c-419c-afe5-556c0a3adfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Flow 'volume_create_manager' (6225b55d-97db-48d8-bcaf-709f55d0550e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:42 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5d8e24cb-d1a6-4448-bd05-fc40eea9441f tempest-VolumesGetTest-1257816987 None] Created volume successfully.
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-1828745b-6b33-45da-a89d-05ae5b65c2fe-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Lock "cinder-1828745b-6b33-45da-a89d-05ae5b65c2fe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-quobyte-1828745b-6b33-45da-a89d-05ae5b65c2fe" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-1828745b-6b33-45da-a89d-05ae5b65c2fe" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bfac94-ebd7-4f8c-a597-7c60a0a5977c]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:42 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe
Feb 28 01:29:42 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:43 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe" returned: 0 in 0.458s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:43 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe
Feb 28 01:29:43 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:43 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1828745b-6b33-45da-a89d-05ae5b65c2fe" returned: 0 in 0.396s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-1828745b-6b33-45da-a89d-05ae5b65c2fe" released by "delete_volume" :: held 0.876s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Created reservations ['0390637c-a56e-442d-94b6-5d2dafda1a61', '7281cf3f-8475-4493-96df-4a10bef8c7ea', 'd1575a1a-8837-4786-8aef-42b971a7a1f1', 'c8aec12c-315c-4545-84b0-1a2d546bfa30'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:43 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:43 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-b96f5a89-163d-4949-a52a-09bc4305dc46-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Lock "cinder-b96f5a89-163d-4949-a52a-09bc4305dc46-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Acquiring lock "cinder-quobyte-b96f5a89-163d-4949-a52a-09bc4305dc46" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-b96f5a89-163d-4949-a52a-09bc4305dc46" acquired by "delete_volume" :: waited 0.019s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[40079c91-d4ab-4bbe-a6d4-9637d4409889]: (4, 'raw') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:43 devstack sudo[89670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46
Feb 28 01:29:43 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:43 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.408s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Deleted volume successfully.
Feb 28 01:29:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8cc959af-56c9-4633-90bc-87fd7bfb78bd tempest-VolumesGetTest-1257816987 None] Lock "cinder-1828745b-6b33-45da-a89d-05ae5b65c2fe-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:44 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46" returned: 0 in 0.474s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:44 devstack sudo[89675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46
Feb 28 01:29:44 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:44 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46" returned: 1 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46' failed. Not Retrying. {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 28 01:29:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:44 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46
Feb 28 01:29:44 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:45 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b96f5a89-163d-4949-a52a-09bc4305dc46" returned: 0 in 0.407s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Lock "cinder-quobyte-b96f5a89-163d-4949-a52a-09bc4305dc46" released by "delete_volume" :: held 1.369s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Created reservations ['6e9359d3-7d35-4c27-8137-7a854f8b7089', '3190e6ac-2ec9-4fc6-8983-f35259ab316b', 'a2f0936f-c3df-445b-bafc-4dd91b3c9cb6', 'a163c676-3476-4df5-87e6-878615889ebf'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:45 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:45 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:45 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.400s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:45 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Deleted volume successfully.
Feb 28 01:29:45 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-60c99e1e-ada5-4e2c-a09b-6a108a23981f tempest-VolumesGetTest-1257816987 None] Lock "cinder-b96f5a89-163d-4949-a52a-09bc4305dc46-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (d10a68e8-439d-4f73-b85d-2694f76527d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fddad8d-7135-47a7-9f15-e06f569829e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fddad8d-7135-47a7-9f15-e06f569829e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-818253823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e23937-027f-492a-a900-0b03281d3ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:47Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a51f69-5f56-48fb-86d1-b74f9f761156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a51f69-5f56-48fb-86d1-b74f9f761156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923b4f41-001f-4238-8d86-76ca121c67e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923b4f41-001f-4238-8d86-76ca121c67e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e23937-027f-492a-a900-0b03281d3ebd', 'volume_name': 'volume-74e23937-027f-492a-a900-0b03281d3ebd', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793ad2b6-6b09-412f-9363-bf11566f6893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793ad2b6-6b09-412f-9363-bf11566f6893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd94a2ee-16c2-41ab-9501-6e282e6a046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:47 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume 74e23937-027f-492a-a900-0b03281d3ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e23937-027f-492a-a900-0b03281d3ebd', 'volume_size': 1}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-818253823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e23937-027f-492a-a900-0b03281d3ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:47Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Creating volume 74e23937-027f-492a-a900-0b03281d3ebd {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:47 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:47 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd 1073741824
Feb 28 01:29:47 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:47 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd 1073741824" returned: 0 in 0.462s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:47 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd
Feb 28 01:29:47 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:48 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd" returned: 0 in 0.386s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd94a2ee-16c2-41ab-9501-6e282e6a046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e23937-027f-492a-a900-0b03281d3ebd', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765c655b-cf9c-4aa3-ac6d-dcfa2d765f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:48 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume volume-74e23937-027f-492a-a900-0b03281d3ebd (74e23937-027f-492a-a900-0b03281d3ebd): created successfully
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765c655b-cf9c-4aa3-ac6d-dcfa2d765f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (d10a68e8-439d-4f73-b85d-2694f76527d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:48 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-9a0c4836-e843-465f-bb8b-6d2d73efcdad tempest-CreateVolumesFromSnapshotTest-660521541 None] Created volume successfully.
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Creating offline snapshot ed360d3f-23ba-4100-a3c1-cecc2f3bc552 of volume 74e23937-027f-492a-a900-0b03281d3ebd {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5165461-1912-4c80-be34-de310f8a5b42]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:48 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd
Feb 28 01:29:48 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:49 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:49 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552 1G
Feb 28 01:29:49 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:49 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552 1G" returned: 0 in 0.441s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e23937-027f-492a-a900-0b03281d3ebd -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:49 devstack sudo[89706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e23937-027f-492a-a900-0b03281d3ebd -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552
Feb 28 01:29:49 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:49 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e23937-027f-492a-a900-0b03281d3ebd -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552" returned: 0 in 0.409s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:49 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552 is being set with open permissions: ugo+rw
Feb 28 01:29:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:49 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552
Feb 28 01:29:49 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:50 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552" returned: 0 in 0.390s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:50 devstack sudo[89714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.info
Feb 28 01:29:50 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:50 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.info" returned: 0 in 0.410s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:50 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.info is being set with open permissions: ugo+rw
Feb 28 01:29:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:50 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.info
Feb 28 01:29:50 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:51 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.info" returned: 0 in 0.403s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:51 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-84e9b7fa-dc24-410e-b2e8-201baa9851e7 tempest-CreateVolumesFromSnapshotTest-660521541 None] Create snapshot completed successfully
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (92fc59ba-fbd6-4cd9-a5e7-ca7818673fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f98e1e-ad7b-4b12-a573-8d4146295fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f98e1e-ad7b-4b12-a573-8d4146295fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1369315520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b86c5a-945a-47d9-b557-bb0f37f32c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:52Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75095c1a-229f-4c20-8c71-58c6651de4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75095c1a-229f-4c20-8c71-58c6651de4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b34ced-76f9-4297-b6ab-efac4d8635b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b34ced-76f9-4297-b6ab-efac4d8635b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b86c5a-945a-47d9-b557-bb0f37f32c66', 'volume_name': 'volume-15b86c5a-945a-47d9-b557-bb0f37f32c66', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa1b8e5-15d5-4f1e-8bbb-df6904165422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa1b8e5-15d5-4f1e-8bbb-df6904165422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e652c12-1402-4f1e-9d34-9d48fba046d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:51 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume 15b86c5a-945a-47d9-b557-bb0f37f32c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b86c5a-945a-47d9-b557-bb0f37f32c66', 'volume_size': 1}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1369315520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b86c5a-945a-47d9-b557-bb0f37f32c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:52Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Creating volume 15b86c5a-945a-47d9-b557-bb0f37f32c66 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:51 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:51 devstack sudo[89721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66 1073741824
Feb 28 01:29:51 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (405aa8ca-191a-482d-8897-d219ff38e342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56d78d9-8b22-428c-874a-55f34657a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56d78d9-8b22-428c-874a-55f34657a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1124229055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c588f9ce-6778-4217-9a57-22fcc4daf2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:52Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3925c703-d80e-4e6c-9194-b3c7f2d9274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3925c703-d80e-4e6c-9194-b3c7f2d9274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120bbeab-fbbb-4ebd-9303-099d4910147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120bbeab-fbbb-4ebd-9303-099d4910147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c588f9ce-6778-4217-9a57-22fcc4daf2a7', 'volume_name': 'volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0237d9da-2b7e-47d5-b6c4-cdda36be2594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0237d9da-2b7e-47d5-b6c4-cdda36be2594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1137ca-2dfe-45c3-8ed6-9bba6788cb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume c588f9ce-6778-4217-9a57-22fcc4daf2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7', 'volume_size': 1}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (5a91f192-ae12-4db2-8b37-697f4690c5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a34e9b-4894-45d7-a30d-d86e4a6d8aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a34e9b-4894-45d7-a30d-d86e4a6d8aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1785794902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68a4f62-9aa6-483d-9e83-77342e10c647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:52Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bfae6a-8d14-4442-9b6a-cd5f35a0a178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bfae6a-8d14-4442-9b6a-cd5f35a0a178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4564a3-4916-4170-addf-b0e28f30c53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4564a3-4916-4170-addf-b0e28f30c53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e68a4f62-9aa6-483d-9e83-77342e10c647', 'volume_name': 'volume-e68a4f62-9aa6-483d-9e83-77342e10c647', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c9ffb3-1c65-4fbf-a7c8-014ce9282383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c9ffb3-1c65-4fbf-a7c8-014ce9282383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc44bdc1-5a2c-4bc4-90c0-a124ce57a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume e68a4f62-9aa6-483d-9e83-77342e10c647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e68a4f62-9aa6-483d-9e83-77342e10c647', 'volume_size': 1}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (e555218d-04c9-47c3-8c28-521dddeebb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bda29b-cb7d-4c40-af35-b5be4f0a2b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66 1073741824" returned: 0 in 0.515s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bda29b-cb7d-4c40-af35-b5be4f0a2b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-765048658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5766f73-2040-492d-af67-e5d3942034ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:52Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb78f81-b2d0-4379-b528-54eb31f7518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb78f81-b2d0-4379-b528-54eb31f7518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80543f84-4eaa-46a6-8bfa-b3151034d574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80543f84-4eaa-46a6-8bfa-b3151034d574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5766f73-2040-492d-af67-e5d3942034ca', 'volume_name': 'volume-e5766f73-2040-492d-af67-e5d3942034ca', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f07b8d-5330-4e4a-a1ee-e1ad74005194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f07b8d-5330-4e4a-a1ee-e1ad74005194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a421b4fc-fd1c-4364-a680-802aaf5efe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume e5766f73-2040-492d-af67-e5d3942034ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5766f73-2040-492d-af67-e5d3942034ca', 'volume_size': 1}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:52 devstack sudo[89726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66
Feb 28 01:29:52 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (4a967d88-d1a7-4646-a2e9-759196b921e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa309932-ff98-4db8-b5bd-62eaa4567731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa309932-ff98-4db8-b5bd-62eaa4567731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080054072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:53Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7772d82d-fff1-41d1-9e92-3f3960e89772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7772d82d-fff1-41d1-9e92-3f3960e89772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c71ebe-cf8d-4aaa-8d8d-162dda221921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c71ebe-cf8d-4aaa-8d8d-162dda221921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d', 'volume_name': 'volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d7dc52-85e0-41c8-8196-01ac6c541011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d7dc52-85e0-41c8-8196-01ac6c541011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04580592-2217-4479-9743-5dcf256f31f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d', 'volume_size': 1}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:52 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66" returned: 0 in 0.428s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1124229055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c588f9ce-6778-4217-9a57-22fcc4daf2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:52Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Creating volume c588f9ce-6778-4217-9a57-22fcc4daf2a7 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:52 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e652c12-1402-4f1e-9d34-9d48fba046d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b86c5a-945a-47d9-b557-bb0f37f32c66', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack sudo[89729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7 1073741824
Feb 28 01:29:52 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87be2df-0fb8-4248-8986-00b975da3629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:52 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume volume-15b86c5a-945a-47d9-b557-bb0f37f32c66 (15b86c5a-945a-47d9-b557-bb0f37f32c66): created successfully
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87be2df-0fb8-4248-8986-00b975da3629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:52 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (92fc59ba-fbd6-4cd9-a5e7-ca7818673fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:52 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e5628725-588c-488b-93b8-ca389519a0e2 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created volume successfully.
Feb 28 01:29:53 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7 1073741824" returned: 0 in 0.459s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:53 devstack sudo[89734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7
Feb 28 01:29:53 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:53 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7" returned: 0 in 0.424s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1785794902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68a4f62-9aa6-483d-9e83-77342e10c647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:52Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Creating volume e68a4f62-9aa6-483d-9e83-77342e10c647 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:53 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1137ca-2dfe-45c3-8ed6-9bba6788cb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:53 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647 1073741824
Feb 28 01:29:53 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e0b848-7a55-47f9-a6a8-70091b0975ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:53 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7 (c588f9ce-6778-4217-9a57-22fcc4daf2a7): created successfully
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e0b848-7a55-47f9-a6a8-70091b0975ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:53 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (405aa8ca-191a-482d-8897-d219ff38e342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:53 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7ac6e19e-f350-4c9b-9a28-507e66122862 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created volume successfully.
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:54 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:54 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:54 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647 1073741824" returned: 0 in 0.454s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:54 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647
Feb 28 01:29:54 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:54 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.388s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:54 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647" returned: 0 in 0.404s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.247s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-765048658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5766f73-2040-492d-af67-e5d3942034ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:52Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Creating volume e5766f73-2040-492d-af67-e5d3942034ca {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:54 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc44bdc1-5a2c-4bc4-90c0-a124ce57a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e68a4f62-9aa6-483d-9e83-77342e10c647', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:54 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca 1073741824
Feb 28 01:29:54 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cdc9792-e04c-460b-abbe-257677d5ad5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:54 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume volume-e68a4f62-9aa6-483d-9e83-77342e10c647 (e68a4f62-9aa6-483d-9e83-77342e10c647): created successfully
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cdc9792-e04c-460b-abbe-257677d5ad5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (5a91f192-ae12-4db2-8b37-697f4690c5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:54 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-0eb202c1-6947-4a85-8e8d-d22fbf2a5726 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created volume successfully.
Feb 28 01:29:55 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca 1073741824" returned: 0 in 0.451s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:55 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca
Feb 28 01:29:55 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:55 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca" returned: 0 in 0.384s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.936s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080054072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360f1f00c7134a7a89999c1e872c3c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:29:53Z,use_quota=True,user_id='1398e767aa1f4e12874fba1742853f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Creating volume dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:29:55 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a421b4fc-fd1c-4364-a680-802aaf5efe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5766f73-2040-492d-af67-e5d3942034ca', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:55 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d 1073741824
Feb 28 01:29:55 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f923db06-1ac2-4c28-beba-12d4c79e70d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:55 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume volume-e5766f73-2040-492d-af67-e5d3942034ca (e5766f73-2040-492d-af67-e5d3942034ca): created successfully
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f923db06-1ac2-4c28-beba-12d4c79e70d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (e555218d-04c9-47c3-8c28-521dddeebb68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:55 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-f8682a7b-b117-4894-ae2f-49f64404a6f4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created volume successfully.
Feb 28 01:29:56 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d 1073741824" returned: 0 in 0.475s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:56 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d
Feb 28 01:29:56 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:56 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d" returned: 0 in 0.382s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04580592-2217-4479-9743-5dcf256f31f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134ebeaa-e103-4737-873a-aabec36608f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:29:56 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Volume volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d (dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d): created successfully
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134ebeaa-e103-4737-873a-aabec36608f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Flow 'volume_create_manager' (4a967d88-d1a7-4646-a2e9-759196b921e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:29:56 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-772e62f3-9d3a-41f0-91bf-400ae284fe75 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created volume successfully.
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:56 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-quobyte-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d605fd89-f8c6-4644-9e1f-00fa83f9dc7e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:57 devstack sudo[89768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d
Feb 28 01:29:57 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:57 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d" returned: 0 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:57 devstack sudo[89773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d
Feb 28 01:29:57 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:57 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d" returned: 0 in 0.388s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d" released by "delete_volume" :: held 0.861s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created reservations ['25537e12-f057-4183-9456-49a42a726103', '419babb8-6de4-4abd-ab18-954550f64324', 'a08a8e83-87cd-483a-ad6c-ef4935737b06', 'ed85b12c-73ac-42e5-955f-fe708bb13db1'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:57 devstack sudo[89776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:57 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-e5766f73-2040-492d-af67-e5d3942034ca-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-e5766f73-2040-492d-af67-e5d3942034ca-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-quobyte-e5766f73-2040-492d-af67-e5d3942034ca" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-e5766f73-2040-492d-af67-e5d3942034ca" acquired by "delete_volume" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a473bce9-69d9-4b8a-9c03-2fe9b62e3785]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:58 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca
Feb 28 01:29:58 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:58 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.426s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:58 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Deleted volume successfully.
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-845df39b-e6f4-47ff-81b0-627517457040 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-dc70f9ea-25d9-4839-a8bf-2bdcb2e50e7d-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:58 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca" returned: 0 in 0.481s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:58 devstack sudo[89784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca
Feb 28 01:29:58 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:59 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e5766f73-2040-492d-af67-e5d3942034ca" returned: 0 in 0.399s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-e5766f73-2040-492d-af67-e5d3942034ca" released by "delete_volume" :: held 0.902s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created reservations ['e50a8c2e-e0c5-4c7b-ae13-be1803d7a928', 'c594a7ec-dcd8-4ee3-a3cb-45edd36d2733', 'de11ba7c-e227-4268-ae6a-f8715dfb2498', 'a1ccf453-38e1-4264-8899-363dfdd49126'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:59 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:29:59 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-e68a4f62-9aa6-483d-9e83-77342e10c647-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-e68a4f62-9aa6-483d-9e83-77342e10c647-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-quobyte-e68a4f62-9aa6-483d-9e83-77342e10c647" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-e68a4f62-9aa6-483d-9e83-77342e10c647" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed50b54-2e17-4f38-9e41-10b812df280e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:59 devstack sudo[89789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647
Feb 28 01:29:59 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:29:59 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.419s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:29:59 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Deleted volume successfully.
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8e14a347-a9ac-4ea7-bb4c-abb36e6d5672 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-e5766f73-2040-492d-af67-e5d3942034ca-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:29:59 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647" returned: 0 in 0.481s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:29:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:29:59 devstack sudo[89795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647
Feb 28 01:29:59 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:00 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-e68a4f62-9aa6-483d-9e83-77342e10c647" returned: 0 in 0.398s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-e68a4f62-9aa6-483d-9e83-77342e10c647" released by "delete_volume" :: held 0.909s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=82,cinder:UPDATE=117,cinder:DELETE=10,cinder:INSERT=28 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created reservations ['d6170587-dd8e-4390-8155-e27ba46b76fd', 'd7a1d8b6-3e97-4aaa-af25-63c7e2ef9106', 'bcc5fdda-7f88-4b82-a3ab-b77d94ae95d9', '2cfa732d-7804-41f9-9c0b-d3eeea2300f8'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:00 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:00 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-c588f9ce-6778-4217-9a57-22fcc4daf2a7-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-c588f9ce-6778-4217-9a57-22fcc4daf2a7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-quobyte-c588f9ce-6778-4217-9a57-22fcc4daf2a7" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-c588f9ce-6778-4217-9a57-22fcc4daf2a7" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e782df45-d067-41b9-bd6b-63eee6c7a710]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:00 devstack sudo[89800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7
Feb 28 01:30:00 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:00 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.416s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:00 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Deleted volume successfully.
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ef41aad7-0dbe-489f-b4c7-d07b3610c585 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-e68a4f62-9aa6-483d-9e83-77342e10c647-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:00 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7" returned: 0 in 0.460s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:00 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7
Feb 28 01:30:00 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:01 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-c588f9ce-6778-4217-9a57-22fcc4daf2a7" returned: 0 in 0.391s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-c588f9ce-6778-4217-9a57-22fcc4daf2a7" released by "delete_volume" :: held 0.872s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created reservations ['2398369c-3e73-443d-8209-c5c5836db019', '51981d3a-f651-4906-b2ff-d8a0ae496e1a', 'bc6a50c0-8ed0-4a27-860a-ea8cfc5454d7', '9451b9fc-a5d8-49e3-b985-e37b561e5a70'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:01 devstack sudo[89809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:01 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-15b86c5a-945a-47d9-b557-bb0f37f32c66-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-15b86c5a-945a-47d9-b557-bb0f37f32c66-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-quobyte-15b86c5a-945a-47d9-b557-bb0f37f32c66" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-15b86c5a-945a-47d9-b557-bb0f37f32c66" acquired by "delete_volume" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8958ed-8b67-4c89-9704-f47a3716256a]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:01 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66
Feb 28 01:30:01 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:01 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.437s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:01 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Deleted volume successfully.
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1f7d5403-9f52-444d-9246-9da8baf90344 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-c588f9ce-6778-4217-9a57-22fcc4daf2a7-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:01 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66" returned: 0 in 0.456s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:01 devstack sudo[89818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66
Feb 28 01:30:01 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:02 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-15b86c5a-945a-47d9-b557-bb0f37f32c66" returned: 0 in 0.395s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-15b86c5a-945a-47d9-b557-bb0f37f32c66" released by "delete_volume" :: held 0.882s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created reservations ['1db6def1-a18f-44bd-8049-8933b3e40552', '7728fea6-1349-4db8-b99a-5c06ff3e7a56', '9c2c5da1-ef5b-4220-a09a-e393a8233a81', '235e4c0d-6113-4b7b-b3ef-e0599b89b2d6'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:02 devstack sudo[89821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:02 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-ed360d3f-23ba-4100-a3c1-cecc2f3bc552-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-ed360d3f-23ba-4100-a3c1-cecc2f3bc552-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-quobyte-74e23937-027f-492a-a900-0b03281d3ebd" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-74e23937-027f-492a-a900-0b03281d3ebd" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-quobyte-ed360d3f-23ba-4100-a3c1-cecc2f3bc552" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-ed360d3f-23ba-4100-a3c1-cecc2f3bc552" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Deleting offline snapshot ed360d3f-23ba-4100-a3c1-cecc2f3bc552 of volume 74e23937-027f-492a-a900-0b03281d3ebd {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] snapshot_file for this snap is: volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[982c4892-f72a-41e1-be33-1f441d321bc7]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:02 devstack sudo[89823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552
Feb 28 01:30:02 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:02 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.421s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:02 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Deleted volume successfully.
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=118,cinder:INSERT=49,cinder:UPDATE=158,cinder:DELETE=17 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:30:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-eebf7b55-a4e1-4ac7-8924-c430e4050b38 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-15b86c5a-945a-47d9-b557-bb0f37f32c66-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:03 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552" returned: 0 in 0.476s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e23937-027f-492a-a900-0b03281d3ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:30:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56202a4-eb1e-49e6-82a7-3514d0014cdf]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:03 devstack sudo[89829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd
Feb 28 01:30:03 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:03 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd" returned: 0 in 0.447s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:03 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552
Feb 28 01:30:03 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:03 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552" returned: 0 in 0.444s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:04 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552
Feb 28 01:30:04 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:04 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd.ed360d3f-23ba-4100-a3c1-cecc2f3bc552" returned: 0 in 0.427s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-ed360d3f-23ba-4100-a3c1-cecc2f3bc552" released by "_delete_snapshot" :: held 1.850s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-74e23937-027f-492a-a900-0b03281d3ebd" released by "delete_snapshot" :: held 1.863s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created reservations ['e2fc2d79-337f-4450-9030-80c2a4783f36', 'aaaa7ae4-968c-4757-b43e-37923e88e1cc', '95be4553-3a14-400e-bb3f-715b8df259a6', '7395f2ee-f75d-41bf-a1ec-87f187fe0b85'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:04 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Delete snapshot completed successfully.
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2e250b63-bc99-48ea-8a71-ef4e6dc1caa4 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-ed360d3f-23ba-4100-a3c1-cecc2f3bc552-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-74e23937-027f-492a-a900-0b03281d3ebd-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-74e23937-027f-492a-a900-0b03281d3ebd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "cinder-quobyte-74e23937-027f-492a-a900-0b03281d3ebd" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-74e23937-027f-492a-a900-0b03281d3ebd" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[398ccb23-017a-449f-8cf6-32cd56454172]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:04 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd
Feb 28 01:30:04 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:05 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd" returned: 0 in 0.455s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:05 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd
Feb 28 01:30:05 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:05 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-74e23937-027f-492a-a900-0b03281d3ebd" returned: 0 in 0.387s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-quobyte-74e23937-027f-492a-a900-0b03281d3ebd" released by "delete_volume" :: held 0.871s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Created reservations ['3062d719-3cc6-402c-a316-f20afea75379', '45400c0c-89ec-422a-99d5-b0a9c5ea210c', '66de6d04-a97b-4361-8fbd-86fe6bdeb8e7', '0d9b0ae4-3eda-4264-a107-0b3867067c63'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:05 devstack sudo[89850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:05 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:06 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.438s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:06 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:06 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Deleted volume successfully.
Feb 28 01:30:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6ac11290-2922-4faa-a88c-cbb983d62260 tempest-CreateVolumesFromSnapshotTest-660521541 None] Lock "cinder-74e23937-027f-492a-a900-0b03281d3ebd-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Flow 'volume_create_manager' (19affbe4-c058-45fd-a476-3e510f3554c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd24fd53-06b5-4de6-b655-4dc3d9372fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd24fd53-06b5-4de6-b655-4dc3d9372fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1876261744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae04178-7b76-4838-88a3-37c89375e469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067059554c6d4cefb1617a86dc8a3534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:07Z,use_quota=True,user_id='8700ffa43212453580a4c7f00f988a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2609b3-22d4-4bf4-98b0-026b976d6518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2609b3-22d4-4bf4-98b0-026b976d6518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c2b24f-8952-4aef-aa4e-38552f0ee5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c2b24f-8952-4aef-aa4e-38552f0ee5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae04178-7b76-4838-88a3-37c89375e469', 'volume_name': 'volume-cae04178-7b76-4838-88a3-37c89375e469', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064c5e13-010e-4377-be2f-3a99d11daa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064c5e13-010e-4377-be2f-3a99d11daa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169a8cec-c513-49db-a3c3-00265261e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:07 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Volume cae04178-7b76-4838-88a3-37c89375e469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae04178-7b76-4838-88a3-37c89375e469', 'volume_size': 1}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1876261744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae04178-7b76-4838-88a3-37c89375e469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067059554c6d4cefb1617a86dc8a3534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:07Z,use_quota=True,user_id='8700ffa43212453580a4c7f00f988a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Creating volume cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:07 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:07 devstack sudo[89853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 1073741824
Feb 28 01:30:07 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:07 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 1073741824" returned: 0 in 0.498s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:08 devstack sudo[89858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469
Feb 28 01:30:08 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:08 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469" returned: 0 in 0.393s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169a8cec-c513-49db-a3c3-00265261e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae04178-7b76-4838-88a3-37c89375e469', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c7bfc7-9386-47fa-bba4-ae2872a1beef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:08 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Volume volume-cae04178-7b76-4838-88a3-37c89375e469 (cae04178-7b76-4838-88a3-37c89375e469): created successfully
Feb 28 01:30:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c7bfc7-9386-47fa-bba4-ae2872a1beef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Flow 'volume_create_manager' (19affbe4-c058-45fd-a476-3e510f3554c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:08 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b32b0f7d-0a86-4370-82b5-fe0162078ac1 tempest-VolumeDependencyTests-446127493 None] Created volume successfully.
Feb 28 01:30:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Creating offline snapshot e3ca6116-3d6d-413e-84f7-80e30bc274e6 of volume cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:30:09 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35d0361-0ef8-4b1e-8770-1b091d05ee08]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:09 devstack sudo[89861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469
Feb 28 01:30:09 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:10 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469" returned: 0 in 0.469s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:10 devstack sudo[89866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 1G
Feb 28 01:30:10 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:10 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 1G" returned: 0 in 0.452s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae04178-7b76-4838-88a3-37c89375e469 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:10 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae04178-7b76-4838-88a3-37c89375e469 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6
Feb 28 01:30:10 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:10 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae04178-7b76-4838-88a3-37c89375e469 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6" returned: 0 in 0.420s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:10 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 is being set with open permissions: ugo+rw
Feb 28 01:30:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:11 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6
Feb 28 01:30:11 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:11 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6" returned: 0 in 0.393s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:11 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.info
Feb 28 01:30:11 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:11 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.info" returned: 0 in 0.400s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:11 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.info is being set with open permissions: ugo+rw
Feb 28 01:30:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:11 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.info
Feb 28 01:30:11 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:12 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.info" returned: 0 in 0.390s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:12 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-6767f344-34d0-41a3-99b0-d43a3f62f017 tempest-VolumeDependencyTests-446127493 None] Create snapshot completed successfully
Feb 28 01:30:12 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Flow 'volume_create_manager' (2042f612-0fab-4618-acdc-92cee584d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61b9ff6-a978-41a0-b247-c2b2922a1ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61b9ff6-a978-41a0-b247-c2b2922a1ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1301133690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb94a7d-ff70-417a-bdd3-0b511beaedc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067059554c6d4cefb1617a86dc8a3534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3ca6116-3d6d-413e-84f7-80e30bc274e6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:13Z,use_quota=True,user_id='8700ffa43212453580a4c7f00f988a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b780826d-4cb3-4373-8e96-cd397f6d3e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b780826d-4cb3-4373-8e96-cd397f6d3e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffd28a8-5dca-46c6-bbf8-2a8cd5f6317f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffd28a8-5dca-46c6-bbf8-2a8cd5f6317f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1cb94a7d-ff70-417a-bdd3-0b511beaedc7', 'volume_name': 'volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7', 'volume_size': 1, 'snapshot_id': 'e3ca6116-3d6d-413e-84f7-80e30bc274e6'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785bcff7-ea75-41f3-b211-2142342a6457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785bcff7-ea75-41f3-b211-2142342a6457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c95de6-450e-4463-b917-863ec4e3e3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:13 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Volume 1cb94a7d-ff70-417a-bdd3-0b511beaedc7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7', 'volume_size': 1, 'snapshot_id': 'e3ca6116-3d6d-413e-84f7-80e30bc274e6'}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-quobyte-e3ca6116-3d6d-413e-84f7-80e30bc274e6-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" by "_create_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-e3ca6116-3d6d-413e-84f7-80e30bc274e6-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Creating volume 1cb94a7d-ff70-417a-bdd3-0b511beaedc7 from snapshot e3ca6116-3d6d-413e-84f7-80e30bc274e6 {{(pid=82470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-quobyte-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] snapshot: e3ca6116-3d6d-413e-84f7-80e30bc274e6, volume: 1cb94a7d-ff70-417a-bdd3-0b511beaedc7,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d25d88-5f30-44f5-9289-dfb33fe95488]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:13 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6
Feb 28 01:30:13 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:13 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6" returned: 0 in 0.458s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cae04178-7b76-4838-88a3-37c89375e469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cba806-ee2e-4241-a525-bfc597acaa0a]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:13 devstack sudo[89891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469
Feb 28 01:30:13 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:14 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:14 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7 not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:30:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:14 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7
Feb 28 01:30:14 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:15 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" returned: 0 in 1.971s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:16 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d93d49-bc0a-49fa-8865-db55ac842710]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:16 devstack sudo[89908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469
Feb 28 01:30:16 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:16 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469" returned: 0 in 0.587s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:16 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469, size 1024.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:30:16 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Converted 1024.00 MB image at 519.31 MB/s
Feb 28 01:30:16 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7 is being set with open permissions: ugo+rw
Feb 28 01:30:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:16 devstack sudo[89913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7
Feb 28 01:30:16 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:16 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" returned: 0 in 0.403s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" released by "_copy_volume_from_snapshot" :: held 3.941s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-e3ca6116-3d6d-413e-84f7-80e30bc274e6-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" released by "_create_volume_from_snapshot" :: held 3.956s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.963s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c95de6-450e-4463-b917-863ec4e3e3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7', 'volume_size': 1, 'snapshot_id': 'e3ca6116-3d6d-413e-84f7-80e30bc274e6'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f87290-a6c3-4481-8bf2-7785cce9c709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:17 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Volume volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7 (1cb94a7d-ff70-417a-bdd3-0b511beaedc7): created successfully
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f87290-a6c3-4481-8bf2-7785cce9c709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Flow 'volume_create_manager' (2042f612-0fab-4618-acdc-92cee584d507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:17 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4615d102-e56a-4bf4-9eda-0da5a2861928 tempest-VolumeDependencyTests-446127493 None] Created volume successfully.
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-e3ca6116-3d6d-413e-84f7-80e30bc274e6-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-e3ca6116-3d6d-413e-84f7-80e30bc274e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-quobyte-cae04178-7b76-4838-88a3-37c89375e469" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-cae04178-7b76-4838-88a3-37c89375e469" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-quobyte-e3ca6116-3d6d-413e-84f7-80e30bc274e6" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-e3ca6116-3d6d-413e-84f7-80e30bc274e6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Deleting offline snapshot e3ca6116-3d6d-413e-84f7-80e30bc274e6 of volume cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] snapshot_file for this snap is: volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13d0630-a945-4008-9c15-2f56804e027f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:17 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6
Feb 28 01:30:17 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:17 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6" returned: 0 in 0.453s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cae04178-7b76-4838-88a3-37c89375e469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81cfda2-cb92-47e6-98e4-f9092b97aaf8]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:17 devstack sudo[89921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469
Feb 28 01:30:17 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:18 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469" returned: 0 in 0.479s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:18 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6
Feb 28 01:30:18 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:18 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6" returned: 0 in 0.448s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:18 devstack sudo[89931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6
Feb 28 01:30:18 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:19 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469.e3ca6116-3d6d-413e-84f7-80e30bc274e6" returned: 0 in 0.422s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-e3ca6116-3d6d-413e-84f7-80e30bc274e6" released by "_delete_snapshot" :: held 1.855s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-cae04178-7b76-4838-88a3-37c89375e469" released by "delete_snapshot" :: held 1.866s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Created reservations ['f6ab2f19-3eb6-4bff-895a-41c4ddc82448', '0d0f6d91-eb83-4468-8a51-598c700dd451', 'efe839d1-aeae-428c-9228-e6788c593714', '690224a3-60c9-4525-9443-9b844d328dad'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:19 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Delete snapshot completed successfully.
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-4d747dff-d786-4c88-8a2c-1f94cc42d536 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-e3ca6116-3d6d-413e-84f7-80e30bc274e6-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-cae04178-7b76-4838-88a3-37c89375e469-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Lock "cinder-cae04178-7b76-4838-88a3-37c89375e469-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-quobyte-cae04178-7b76-4838-88a3-37c89375e469" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-cae04178-7b76-4838-88a3-37c89375e469" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc44e38-28eb-477d-9f8a-bcebe1d817bf]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:19 devstack sudo[89934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469
Feb 28 01:30:19 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:19 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469" returned: 0 in 0.473s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:19 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469
Feb 28 01:30:19 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:20 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-cae04178-7b76-4838-88a3-37c89375e469" returned: 0 in 0.398s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-cae04178-7b76-4838-88a3-37c89375e469" released by "delete_volume" :: held 0.908s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Created reservations ['a3b75000-7990-4ffd-ae9f-48c2a9c56800', '5ca49365-07a1-4f9b-b100-1fe08cbaf15a', 'e3965cec-9cde-47cf-9c84-b1f5c862ca39', 'd0d3f3b4-b3d6-4db8-bf1f-f05aa98019cc'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:20 devstack sudo[89942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:20 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Flow 'volume_create_manager' (254a2bbe-8d0d-4790-8d85-0805e6996eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b685ac-88f8-47b9-bfa4-62fd920a71f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b685ac-88f8-47b9-bfa4-62fd920a71f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-269988642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067059554c6d4cefb1617a86dc8a3534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:21Z,use_quota=True,user_id='8700ffa43212453580a4c7f00f988a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9191fff-f174-4c57-afc1-1a99cb2a6a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9191fff-f174-4c57-afc1-1a99cb2a6a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776afa52-a4fb-4131-aea9-17092c4ab23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776afa52-a4fb-4131-aea9-17092c4ab23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba', 'volume_name': 'volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3755cae6-f686-40fc-86ab-755dc5f4a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3755cae6-f686-40fc-86ab-755dc5f4a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3d997b-1740-4411-87a4-e4707d275840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:20 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Volume ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba', 'volume_size': 1}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-269988642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067059554c6d4cefb1617a86dc8a3534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:21Z,use_quota=True,user_id='8700ffa43212453580a4c7f00f988a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Creating volume ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:20 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:20 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba 1073741824
Feb 28 01:30:20 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:20 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.442s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Deleted volume successfully.
Feb 28 01:30:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-da4b32f3-0559-4b39-910d-90d875f18fdb tempest-VolumeDependencyTests-446127493 None] Lock "cinder-cae04178-7b76-4838-88a3-37c89375e469-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:21 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba 1073741824" returned: 0 in 0.468s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:21 devstack sudo[89950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba
Feb 28 01:30:21 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:21 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba" returned: 0 in 0.394s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3d997b-1740-4411-87a4-e4707d275840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0810df-2d3b-4cdc-acf9-d7b0cb8d87b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:21 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Volume volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba (ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba): created successfully
Feb 28 01:30:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0810df-2d3b-4cdc-acf9-d7b0cb8d87b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Flow 'volume_create_manager' (254a2bbe-8d0d-4790-8d85-0805e6996eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:21 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e634fce0-148d-4275-bec1-12d725259f8b tempest-VolumeDependencyTests-446127493 None] Created volume successfully.
Feb 28 01:30:21 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Flow 'volume_create_manager' (f7282343-a49d-400f-9cb8-3a50c64e91a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198dd432-2b5f-418c-9b8b-38f2200e2bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198dd432-2b5f-418c-9b8b-38f2200e2bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1511292283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2954d0-abd4-49df-9fa2-7bb587719497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067059554c6d4cefb1617a86dc8a3534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:22Z,use_quota=True,user_id='8700ffa43212453580a4c7f00f988a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372734cb-bc2a-4127-a9af-3e7a5b65e7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372734cb-bc2a-4127-a9af-3e7a5b65e7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389c1d4c-655e-48c7-9cdb-b2c176278561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389c1d4c-655e-48c7-9cdb-b2c176278561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4d2954d0-abd4-49df-9fa2-7bb587719497', 'volume_name': 'volume-4d2954d0-abd4-49df-9fa2-7bb587719497', 'volume_size': 1, 'source_volid': 'ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba', 'source_volstatus': 'available'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2674e2-a779-4dc6-8128-ddeb29fc1a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2674e2-a779-4dc6-8128-ddeb29fc1a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b804384b-d4e0-445a-994a-18499083c15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:22 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Volume 4d2954d0-abd4-49df-9fa2-7bb587719497: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4d2954d0-abd4-49df-9fa2-7bb587719497', 'volume_size': 1, 'source_volid': 'ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba', 'source_volstatus': 'available'}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:22 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Cloning volume ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba to volume 4d2954d0-abd4-49df-9fa2-7bb587719497
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Creating offline snapshot fbb71385-a4a9-49e0-bf13-744df2a4a3f5 of volume ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cda2fc-9b55-4be5-b0e0-76481f033767]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:22 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba
Feb 28 01:30:22 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:22 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba" returned: 0 in 0.464s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:22 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 1G
Feb 28 01:30:22 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:23 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 1G" returned: 0 in 0.484s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:23 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5
Feb 28 01:30:23 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:23 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5" returned: 0 in 0.405s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:23 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 is being set with open permissions: ugo+rw
Feb 28 01:30:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:23 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5
Feb 28 01:30:23 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:23 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5" returned: 0 in 0.396s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:23 devstack sudo[89972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.info
Feb 28 01:30:23 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:24 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.info" returned: 0 in 0.419s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:24 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.info is being set with open permissions: ugo+rw
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:24 devstack sudo[89975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.info
Feb 28 01:30:24 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:24 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.info" returned: 0 in 0.393s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-quobyte-4d2954d0-abd4-49df-9fa2-7bb587719497" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-4d2954d0-abd4-49df-9fa2-7bb587719497" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] snapshot: fbb71385-a4a9-49e0-bf13-744df2a4a3f5, volume: 4d2954d0-abd4-49df-9fa2-7bb587719497,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2af796c-3d88-4447-b215-ef4bc8ccaf54]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:24 devstack sudo[89978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5
Feb 28 01:30:24 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:25 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5" returned: 0 in 0.462s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:30:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:30:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:30:25 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7f2887-188c-47a3-bde0-b4f18cb03754]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:25 devstack sudo[89983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba
Feb 28 01:30:25 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:25 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba" returned: 0 in 0.451s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:25 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497 not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:30:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:25 devstack sudo[89988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497
Feb 28 01:30:25 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:27 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497" returned: 0 in 2.029s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:27 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8583296c-1e11-4036-b6e6-34fdc7c604d4]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:27 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba
Feb 28 01:30:27 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:28 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba" returned: 0 in 0.588s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:30:28 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Converted 1024.00 MB image at 504.42 MB/s
Feb 28 01:30:28 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497 is being set with open permissions: ugo+rw
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:28 devstack sudo[90005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497
Feb 28 01:30:28 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:28 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497" returned: 0 in 0.395s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-4d2954d0-abd4-49df-9fa2-7bb587719497" released by "_copy_volume_from_snapshot" :: held 3.966s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-quobyte-fbb71385-a4a9-49e0-bf13-744df2a4a3f5" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-fbb71385-a4a9-49e0-bf13-744df2a4a3f5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Deleting offline snapshot fbb71385-a4a9-49e0-bf13-744df2a4a3f5 of volume ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] snapshot_file for this snap is: volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[45262f9d-c8eb-4909-a8e0-3a324af680ad]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:28 devstack sudo[90008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5
Feb 28 01:30:28 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:29 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5" returned: 0 in 0.481s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:29 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:30:29 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b436fe42-7e2f-4bcc-a877-8f55a7e7027e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:29 devstack sudo[90013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba
Feb 28 01:30:29 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:29 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba" returned: 0 in 0.454s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:29 devstack sudo[90018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5
Feb 28 01:30:29 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:30 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5" returned: 0 in 0.446s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:30 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5
Feb 28 01:30:30 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:30 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba.fbb71385-a4a9-49e0-bf13-744df2a4a3f5" returned: 0 in 0.408s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-fbb71385-a4a9-49e0-bf13-744df2a4a3f5" released by "_delete_snapshot" :: held 1.830s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.465s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b804384b-d4e0-445a-994a-18499083c15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2954d0-abd4-49df-9fa2-7bb587719497', 'volume_size': 1, 'source_volid': 'ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba', 'source_volstatus': 'available'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba59ab4-e223-414b-88e5-2d1c6b7a0b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:30 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Volume volume-4d2954d0-abd4-49df-9fa2-7bb587719497 (4d2954d0-abd4-49df-9fa2-7bb587719497): created successfully
Feb 28 01:30:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba59ab4-e223-414b-88e5-2d1c6b7a0b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:30 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Flow 'volume_create_manager' (f7282343-a49d-400f-9cb8-3a50c64e91a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:30 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-98f3b858-2aa1-492e-ae1b-d8e69ca6191f tempest-VolumeDependencyTests-446127493 None] Created volume successfully.
Feb 28 01:30:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-quobyte-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:31 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:31 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e813582-f82e-48f9-a191-e88a9efa4eec]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:31 devstack sudo[90026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba
Feb 28 01:30:31 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:32 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:32 devstack sudo[90032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba
Feb 28 01:30:32 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:32 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba" returned: 0 in 0.405s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba" released by "delete_volume" :: held 0.899s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Created reservations ['658aefa0-3f50-4e7c-8335-6195d40d9293', '8b2b362d-7b1b-41a7-ba94-4f741019df02', '441b0141-1a96-46e7-97c0-ae18f7630a21', '88ddd4f8-32f6-46c7-abfb-b07ee6a2e731'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:32 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:32 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-4d2954d0-abd4-49df-9fa2-7bb587719497-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-4d2954d0-abd4-49df-9fa2-7bb587719497-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-quobyte-4d2954d0-abd4-49df-9fa2-7bb587719497" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-4d2954d0-abd4-49df-9fa2-7bb587719497" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d7abe4-72db-4cf2-bd78-c58f35bda49b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:32 devstack sudo[90037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497
Feb 28 01:30:32 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:32 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.427s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:32 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Deleted volume successfully.
Feb 28 01:30:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-70235967-1a21-441d-b0a0-95526c26fed6 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-ff9bb7bb-2aba-46ac-a8a1-4f0f256a71ba-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:33 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497" returned: 0 in 0.459s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:33 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497
Feb 28 01:30:33 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:33 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4d2954d0-abd4-49df-9fa2-7bb587719497" returned: 0 in 0.403s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-4d2954d0-abd4-49df-9fa2-7bb587719497" released by "delete_volume" :: held 0.891s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Created reservations ['d0c3aebe-7dce-4bfe-b42e-28059d69c124', 'f4d37211-795c-470f-a788-1bfe92deb008', 'bd49f16e-1a0d-4117-9c3c-e8474208fffc', '8cc6d28d-dc77-4410-b15b-4fcdee7b5082'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:33 devstack sudo[90046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:33 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-1cb94a7d-ff70-417a-bdd3-0b511beaedc7-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-1cb94a7d-ff70-417a-bdd3-0b511beaedc7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "cinder-quobyte-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d9a24f-4362-4575-8362-eefacc6856ef]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:33 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7
Feb 28 01:30:33 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:34 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.419s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:34 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Deleted volume successfully.
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bd7a3de6-1867-4be6-85a5-728aaf328d24 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-4d2954d0-abd4-49df-9fa2-7bb587719497-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:34 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" returned: 0 in 0.471s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:34 devstack sudo[90054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7
Feb 28 01:30:34 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:34 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" returned: 0 in 0.397s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-quobyte-1cb94a7d-ff70-417a-bdd3-0b511beaedc7" released by "delete_volume" :: held 0.896s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Created reservations ['d2b54043-f36a-4c35-8dee-9c63afab15b6', '7eed792b-0f43-43fd-bf2a-b57b671a4651', 'ed1feb40-071c-4a11-836c-bdcbc276f165', '1145f15f-6c6a-4511-ac38-abe5377c479d'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:34 devstack sudo[90057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:34 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:35 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.439s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:35 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:35 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Deleted volume successfully.
Feb 28 01:30:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-f444c11b-366e-4ca1-beba-d70dcb74d036 tempest-VolumeDependencyTests-446127493 None] Lock "cinder-1cb94a7d-ff70-417a-bdd3-0b511beaedc7-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (3a75777d-2aa3-4af4-a466-b18748268871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e6db22-1889-4bc3-bf9f-80f1dc64d55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e6db22-1889-4bc3-bf9f-80f1dc64d55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1115774957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f672b0-7119-4593-82a6-6bcf7487496e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:42Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adce2f80-99bb-4e01-b182-2be71b2e47fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adce2f80-99bb-4e01-b182-2be71b2e47fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2ae862-4762-4708-8722-7bfefba7b029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2ae862-4762-4708-8722-7bfefba7b029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f672b0-7119-4593-82a6-6bcf7487496e', 'volume_name': 'volume-89f672b0-7119-4593-82a6-6bcf7487496e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3c9d4d-9c95-4feb-94f3-5532711caf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3c9d4d-9c95-4feb-94f3-5532711caf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bead638c-1d98-4447-8623-d0868be58750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume 89f672b0-7119-4593-82a6-6bcf7487496e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f672b0-7119-4593-82a6-6bcf7487496e', 'volume_size': 1}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1115774957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f672b0-7119-4593-82a6-6bcf7487496e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:42Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Creating volume 89f672b0-7119-4593-82a6-6bcf7487496e {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:42 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:42 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e 1073741824
Feb 28 01:30:42 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Flow 'volume_create_manager' (2d89c1d1-d120-47d1-8549-3204983e9bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a821e60-df22-499e-b791-485dfc8fca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a821e60-df22-499e-b791-485dfc8fca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209914260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9ef954-b445-4c01-bdd6-43c37a305575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f273f366d2d4da9bfc61f67a1889c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:42Z,use_quota=True,user_id='bff3efeac13049d48026e1162e5102e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb87b831-d9db-4b03-b0b0-cf04da856244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb87b831-d9db-4b03-b0b0-cf04da856244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4966421-c973-4daf-a023-cfa85f3bfe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4966421-c973-4daf-a023-cfa85f3bfe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9ef954-b445-4c01-bdd6-43c37a305575', 'volume_name': 'volume-4c9ef954-b445-4c01-bdd6-43c37a305575', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4bda57-2a63-406a-a0ed-d1472064e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4bda57-2a63-406a-a0ed-d1472064e208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92801c4e-5385-4ced-aac2-0ffa820d6706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Volume 4c9ef954-b445-4c01-bdd6-43c37a305575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9ef954-b445-4c01-bdd6-43c37a305575', 'volume_size': 1}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Flow 'volume_create_manager' (cb16f160-7525-4362-8bfc-1783c8d46449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fd1307-e157-433d-96a6-8cbadd0e305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Flow 'volume_create_manager' (9bda4132-ed44-47c1-a8e1-d175a07e0928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e7b0e6-7c50-4a27-9472-2b870ce9d79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e7b0e6-7c50-4a27-9472-2b870ce9d79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1266070237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b553f28d-9100-4834-9f70-6870ac5de807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2294abd465784e5fb8486e7543be4874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:42Z,use_quota=True,user_id='9b96cce48f1243888c60fddb36467e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4f7296-7533-446f-b5cc-2a162ee43e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4f7296-7533-446f-b5cc-2a162ee43e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf196517-0a49-4a1a-a8f9-02d9666c5c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf196517-0a49-4a1a-a8f9-02d9666c5c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b553f28d-9100-4834-9f70-6870ac5de807', 'volume_name': 'volume-b553f28d-9100-4834-9f70-6870ac5de807', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc4d54c-afbf-444e-9d8f-9db8d72bb0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc4d54c-afbf-444e-9d8f-9db8d72bb0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5bbced-9b6a-4340-9858-b3a8240f840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Volume b553f28d-9100-4834-9f70-6870ac5de807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b553f28d-9100-4834-9f70-6870ac5de807', 'volume_size': 1}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fd1307-e157-433d-96a6-8cbadd0e305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1633317133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f273f366d2d4da9bfc61f67a1889c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:42Z,use_quota=True,user_id='bff3efeac13049d48026e1162e5102e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a39247-df3a-479b-bf86-270beba9f077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a39247-df3a-479b-bf86-270beba9f077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3a904d-a788-47b0-9a53-2bee614e5d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3a904d-a788-47b0-9a53-2bee614e5d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7', 'volume_name': 'volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acea429b-fc8e-46eb-b984-4dbf8b18cbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acea429b-fc8e-46eb-b984-4dbf8b18cbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3504eea-1d32-4a29-aa7f-2d1a36e76f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Volume 8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7', 'volume_size': 1}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Flow 'volume_create_manager' (7ceaec7a-1279-40b6-ae20-b1ef048d50de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c4086d-21e7-4f4a-8f74-250a902c05bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c4086d-21e7-4f4a-8f74-250a902c05bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2142898189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e1b443-8bd7-4976-af40-fc1b22523895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f273f366d2d4da9bfc61f67a1889c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:43Z,use_quota=True,user_id='bff3efeac13049d48026e1162e5102e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d69739-c0d1-4f2b-a8e4-0bfeb357835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d69739-c0d1-4f2b-a8e4-0bfeb357835c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ae9a3f-fd3d-4d3e-ac0b-6ec916617a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ae9a3f-fd3d-4d3e-ac0b-6ec916617a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e1b443-8bd7-4976-af40-fc1b22523895', 'volume_name': 'volume-90e1b443-8bd7-4976-af40-fc1b22523895', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f04fa6e-f820-42ab-b3f4-9e42ecf7968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f04fa6e-f820-42ab-b3f4-9e42ecf7968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3c88f1-ff19-4dd7-9757-9b82a0b2c31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Volume 90e1b443-8bd7-4976-af40-fc1b22523895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e1b443-8bd7-4976-af40-fc1b22523895', 'volume_size': 1}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Flow 'volume_create_manager' (a05ae696-50c6-4f60-8a30-f92203fbb5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78833a90-c280-4d02-9f75-146f781cfa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78833a90-c280-4d02-9f75-146f781cfa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485711462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a4e0fa-ff64-4191-abb1-b6b542ba84bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f273f366d2d4da9bfc61f67a1889c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:43Z,use_quota=True,user_id='bff3efeac13049d48026e1162e5102e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82bb253-08d4-4208-8e35-a6e3674620ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82bb253-08d4-4208-8e35-a6e3674620ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb22565f-21cf-41a0-b5e7-7d6c66fb3442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb22565f-21cf-41a0-b5e7-7d6c66fb3442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a4e0fa-ff64-4191-abb1-b6b542ba84bd', 'volume_name': 'volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c76b8c4-a0e9-44cb-bd43-de6cbd811138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c76b8c4-a0e9-44cb-bd43-de6cbd811138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f8e733-cb12-487a-a9d8-b8e961fbeac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:42 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Volume 73a4e0fa-ff64-4191-abb1-b6b542ba84bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd', 'volume_size': 1}
Feb 28 01:30:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:43 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Flow 'volume_create_manager' (fbc193fe-b6ef-4660-a09c-1e839c6f995c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9561245-8700-45c0-a274-410ccabf0cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e 1073741824" returned: 0 in 0.777s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9561245-8700-45c0-a274-410ccabf0cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-232318944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df81624d-cb33-4710-8f47-4fae8e15893f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f273f366d2d4da9bfc61f67a1889c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:43Z,use_quota=True,user_id='bff3efeac13049d48026e1162e5102e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69dbff6e-f3b5-42d8-b86c-eec64e3a1dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69dbff6e-f3b5-42d8-b86c-eec64e3a1dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6aec15-68d2-4d2a-be55-7f79a5adf33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6aec15-68d2-4d2a-be55-7f79a5adf33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df81624d-cb33-4710-8f47-4fae8e15893f', 'volume_name': 'volume-df81624d-cb33-4710-8f47-4fae8e15893f', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c1d737-da39-415c-86b6-fe76a27e15eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c1d737-da39-415c-86b6-fe76a27e15eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8020b53-a409-46ee-b68c-0ebbf7015114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:43 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Volume df81624d-cb33-4710-8f47-4fae8e15893f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df81624d-cb33-4710-8f47-4fae8e15893f', 'volume_size': 1}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:43 devstack sudo[90150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e
Feb 28 01:30:43 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:43 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e" returned: 0 in 0.451s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.148s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209914260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9ef954-b445-4c01-bdd6-43c37a305575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f273f366d2d4da9bfc61f67a1889c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:42Z,use_quota=True,user_id='bff3efeac13049d48026e1162e5102e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Creating volume 4c9ef954-b445-4c01-bdd6-43c37a305575 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:43 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:43 devstack sudo[90153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575 1073741824
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bead638c-1d98-4447-8623-d0868be58750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f672b0-7119-4593-82a6-6bcf7487496e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:43 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8d923f-1a37-465b-9e61-77c11a3153b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:43 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume volume-89f672b0-7119-4593-82a6-6bcf7487496e (89f672b0-7119-4593-82a6-6bcf7487496e): created successfully
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8d923f-1a37-465b-9e61-77c11a3153b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:43 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (3a75777d-2aa3-4af4-a466-b18748268871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e1fbbddf-245a-44f8-a550-ba8f80528ae5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created volume successfully.
Feb 28 01:30:44 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575 1073741824" returned: 0 in 0.501s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:44 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575
Feb 28 01:30:44 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:44 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575" returned: 0 in 0.455s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.979s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1266070237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b553f28d-9100-4834-9f70-6870ac5de807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2294abd465784e5fb8486e7543be4874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:42Z,use_quota=True,user_id='9b96cce48f1243888c60fddb36467e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Creating volume b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:44 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:44 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 1073741824
Feb 28 01:30:44 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92801c4e-5385-4ced-aac2-0ffa820d6706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9ef954-b445-4c01-bdd6-43c37a305575', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09b2a92-4655-40d9-a5c7-f2616947144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:44 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Volume volume-4c9ef954-b445-4c01-bdd6-43c37a305575 (4c9ef954-b445-4c01-bdd6-43c37a305575): created successfully
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09b2a92-4655-40d9-a5c7-f2616947144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:44 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Flow 'volume_create_manager' (2d89c1d1-d120-47d1-8549-3204983e9bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:44 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e62dec35-e1a5-442f-b513-521cb8727a5e tempest-CreateVolumesFromImageTest-1417324467 None] Created volume successfully.
Feb 28 01:30:45 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 1073741824" returned: 0 in 0.548s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:45 devstack sudo[90166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807
Feb 28 01:30:45 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:45 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807" returned: 0 in 0.436s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.957s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1633317133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f273f366d2d4da9bfc61f67a1889c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:42Z,use_quota=True,user_id='bff3efeac13049d48026e1162e5102e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Creating volume 8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:45 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5bbced-9b6a-4340-9858-b3a8240f840a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b553f28d-9100-4834-9f70-6870ac5de807', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a7e076-27c4-406b-a77f-f75b2fc045a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:45 devstack sudo[90169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7 1073741824
Feb 28 01:30:45 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:45 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Volume volume-b553f28d-9100-4834-9f70-6870ac5de807 (b553f28d-9100-4834-9f70-6870ac5de807): created successfully
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a7e076-27c4-406b-a77f-f75b2fc045a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:45 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Flow 'volume_create_manager' (9bda4132-ed44-47c1-a8e1-d175a07e0928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:45 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c415d7be-904f-4ce2-a920-8e69c0ef94f6 tempest-VolumeDependencyTests-579031880 None] Created volume successfully.
Feb 28 01:30:46 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7 1073741824" returned: 0 in 0.542s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:46 devstack sudo[90174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7
Feb 28 01:30:46 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:46 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7" returned: 0 in 0.495s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.949s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2142898189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e1b443-8bd7-4976-af40-fc1b22523895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f273f366d2d4da9bfc61f67a1889c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:43Z,use_quota=True,user_id='bff3efeac13049d48026e1162e5102e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Creating volume 90e1b443-8bd7-4976-af40-fc1b22523895 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:46 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3504eea-1d32-4a29-aa7f-2d1a36e76f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:46 devstack sudo[90177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895 1073741824
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40eea5c0-3caf-4f83-ab5c-d977f34699c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:46 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:46 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Volume volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7 (8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7): created successfully
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40eea5c0-3caf-4f83-ab5c-d977f34699c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Flow 'volume_create_manager' (cb16f160-7525-4362-8bfc-1783c8d46449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:46 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-f8d7b8c3-613b-484a-be13-687ff3366c10 tempest-CreateVolumesFromImageTest-1417324467 None] Created volume successfully.
Feb 28 01:30:46 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:47 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895 1073741824" returned: 0 in 0.611s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:47 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895
Feb 28 01:30:47 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:47 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895" returned: 0 in 0.540s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.951s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485711462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a4e0fa-ff64-4191-abb1-b6b542ba84bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f273f366d2d4da9bfc61f67a1889c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:43Z,use_quota=True,user_id='bff3efeac13049d48026e1162e5102e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Creating volume 73a4e0fa-ff64-4191-abb1-b6b542ba84bd {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:47 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:47 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3c88f1-ff19-4dd7-9757-9b82a0b2c31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e1b443-8bd7-4976-af40-fc1b22523895', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5515259-2a1b-4d8c-ad1d-ccf31d5aacf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:48 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd 1073741824
Feb 28 01:30:48 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:48 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Volume volume-90e1b443-8bd7-4976-af40-fc1b22523895 (90e1b443-8bd7-4976-af40-fc1b22523895): created successfully
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5515259-2a1b-4d8c-ad1d-ccf31d5aacf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Flow 'volume_create_manager' (7ceaec7a-1279-40b6-ae20-b1ef048d50de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:48 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c8473ded-867f-4eb0-b256-3d5d1234377a tempest-CreateVolumesFromImageTest-1417324467 None] Created volume successfully.
Feb 28 01:30:48 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd 1073741824" returned: 0 in 0.560s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:48 devstack sudo[90190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd
Feb 28 01:30:48 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:48 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd" returned: 0 in 0.431s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.806s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-232318944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df81624d-cb33-4710-8f47-4fae8e15893f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f273f366d2d4da9bfc61f67a1889c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:43Z,use_quota=True,user_id='bff3efeac13049d48026e1162e5102e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Creating volume df81624d-cb33-4710-8f47-4fae8e15893f {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:48 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:48 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f8e733-cb12-487a-a9d8-b8e961fbeac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e8df8f-4721-42a2-ab18-b4f2cde126c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:49 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f 1073741824
Feb 28 01:30:49 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:49 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Volume volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd (73a4e0fa-ff64-4191-abb1-b6b542ba84bd): created successfully
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e8df8f-4721-42a2-ab18-b4f2cde126c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Flow 'volume_create_manager' (a05ae696-50c6-4f60-8a30-f92203fbb5db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:49 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-f719b461-c897-4b99-8942-6ba56b46c208 tempest-CreateVolumesFromImageTest-1417324467 None] Created volume successfully.
Feb 28 01:30:49 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f 1073741824" returned: 0 in 0.499s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:49 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f
Feb 28 01:30:49 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:49 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f" returned: 0 in 0.421s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.370s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Creating offline snapshot 568ffdf5-c60f-4db4-8844-c0c96bb4eb52 of volume 89f672b0-7119-4593-82a6-6bcf7487496e {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8020b53-a409-46ee-b68c-0ebbf7015114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df81624d-cb33-4710-8f47-4fae8e15893f', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807dea76-db63-41c7-bb1f-dcbfdad8a57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1cdfd4-92c1-45c9-bbd4-0b744e4b3c12]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:49 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:50 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Volume volume-df81624d-cb33-4710-8f47-4fae8e15893f (df81624d-cb33-4710-8f47-4fae8e15893f): created successfully
Feb 28 01:30:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807dea76-db63-41c7-bb1f-dcbfdad8a57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:50 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Flow 'volume_create_manager' (fbc193fe-b6ef-4660-a09c-1e839c6f995c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:50 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d4a4d81a-f40b-4546-9f88-0a657bb51f21 tempest-CreateVolumesFromImageTest-1417324467 None] Created volume successfully.
Feb 28 01:30:50 devstack sudo[90201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e
Feb 28 01:30:50 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:50 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e" returned: 0 in 0.497s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:50 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52 1G
Feb 28 01:30:50 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "cinder-df81624d-cb33-4710-8f47-4fae8e15893f-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-df81624d-cb33-4710-8f47-4fae8e15893f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "cinder-quobyte-df81624d-cb33-4710-8f47-4fae8e15893f" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:50 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-quobyte-df81624d-cb33-4710-8f47-4fae8e15893f" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:50 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[53629c0f-2629-4733-835a-b57a6d6942f0]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:50 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:50 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f
Feb 28 01:30:50 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:51 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52 1G" returned: 0 in 0.557s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f672b0-7119-4593-82a6-6bcf7487496e -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:51 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f672b0-7119-4593-82a6-6bcf7487496e -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52
Feb 28 01:30:51 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:51 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:51 devstack sudo[90218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f
Feb 28 01:30:51 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:51 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f672b0-7119-4593-82a6-6bcf7487496e -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52" returned: 0 in 0.487s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:51 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52 is being set with open permissions: ugo+rw
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:51 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52
Feb 28 01:30:51 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:51 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-df81624d-cb33-4710-8f47-4fae8e15893f" returned: 0 in 0.479s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-quobyte-df81624d-cb33-4710-8f47-4fae8e15893f" released by "delete_volume" :: held 1.034s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Created reservations ['479bfb4a-d1d0-48b6-8d27-ca60437bc56e', '8b39d026-703a-4079-b75f-bc4b0ed02908', '70db9853-6e8e-473e-a707-37d59f76a780', '7fe05e86-befb-425c-b90f-68c26fb27c11'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:51 devstack sudo[90228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:51 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:51 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:51 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52" returned: 0 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:52 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.info
Feb 28 01:30:52 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:52 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.434s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:52 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Deleted volume successfully.
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1510e502-c602-481c-ab7f-d494bbd262d6 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-df81624d-cb33-4710-8f47-4fae8e15893f-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:52 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.info" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:52 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.info is being set with open permissions: ugo+rw
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:52 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.info
Feb 28 01:30:52 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:52 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.info" returned: 0 in 0.428s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.944s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.038s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Creating offline snapshot 362c0f52-ea79-42d7-826d-706c41bbef1b of volume b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b41907-14c9-4cc0-b9de-f7b75d54589b]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:52 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-16737cc8-0ab9-4081-ba86-885cf74096b8 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Create snapshot completed successfully
Feb 28 01:30:52 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "cinder-73a4e0fa-ff64-4191-abb1-b6b542ba84bd-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-73a4e0fa-ff64-4191-abb1-b6b542ba84bd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "cinder-quobyte-73a4e0fa-ff64-4191-abb1-b6b542ba84bd" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:53 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-quobyte-73a4e0fa-ff64-4191-abb1-b6b542ba84bd" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:53 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807
Feb 28 01:30:53 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:53 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce853f5-79b3-4bef-99f9-c969ab864a82]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:53 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd
Feb 28 01:30:53 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:53 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807" returned: 0 in 0.590s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:53 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b 1G
Feb 28 01:30:53 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:53 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd" returned: 0 in 0.574s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:53 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:53 devstack sudo[90249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd
Feb 28 01:30:53 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:54 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:54 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-73a4e0fa-ff64-4191-abb1-b6b542ba84bd" returned: 0 in 0.622s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:54 devstack sudo[90255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:54 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (2f52b6f8-1554-4b84-a292-f4fb7fc829e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9d9642-d0df-4500-b4bf-2246ecf65128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b 1G" returned: 0 in 0.808s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b553f28d-9100-4834-9f70-6870ac5de807 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-quobyte-73a4e0fa-ff64-4191-abb1-b6b542ba84bd" released by "delete_volume" :: held 1.331s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9d9642-d0df-4500-b4bf-2246ecf65128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813413849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc96d06-2097-4c1d-aff5-b983a27a9a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:54Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adac17a0-2ea5-412b-9957-b2d731afb1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adac17a0-2ea5-412b-9957-b2d731afb1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf80f2e-8f56-476b-9bdb-a6f6c68e8d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf80f2e-8f56-476b-9bdb-a6f6c68e8d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc96d06-2097-4c1d-aff5-b983a27a9a8e', 'volume_name': 'volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:54 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b553f28d-9100-4834-9f70-6870ac5de807 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbe72d2-9849-4583-a9f6-55d3a5b8ed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:54 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbe72d2-9849-4583-a9f6-55d3a5b8ed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9bb047-f3a8-4c46-ab3b-8605e7a173f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:54 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume 4fc96d06-2097-4c1d-aff5-b983a27a9a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e', 'volume_size': 1}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Created reservations ['3c420d65-dc80-4846-a632-d0eeea0444c8', 'f34f1252-6094-47af-8caa-268feb08c81f', '1cdb0e07-9ad7-425d-b942-09ce2a36529a', '6418026f-313f-4535-aecf-6b389be9de71'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (41006f4a-c642-49f6-b48d-628b8380e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918ff2f8-310b-4d0b-b445-078e5be7caa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918ff2f8-310b-4d0b-b445-078e5be7caa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571161942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423fa65b-b6e8-41d3-a4e3-decce8c5c166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:55Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0d8c9a-4c53-49c3-91f0-da798bb3c35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0d8c9a-4c53-49c3-91f0-da798bb3c35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535df13a-abb5-4773-a8de-21011fd63617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535df13a-abb5-4773-a8de-21011fd63617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '423fa65b-b6e8-41d3-a4e3-decce8c5c166', 'volume_name': 'volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1697ce-13be-4ff2-b4f9-c7df795851d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1697ce-13be-4ff2-b4f9-c7df795851d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d3bca9-bf4f-445e-8c0d-bf1dddacebb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:54 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume 423fa65b-b6e8-41d3-a4e3-decce8c5c166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166', 'volume_size': 1}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:54 devstack sudo[90260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:54 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:54 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:54 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (fc5ab155-0b30-4ad3-9a9e-2a391a393b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbbc054-43ee-41c7-a33b-637cb1014313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.790s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbbc054-43ee-41c7-a33b-637cb1014313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2089351663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91232adf-ade8-458a-b2a0-e1f6cfe0d1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:55Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f55751-fe07-42d3-a620-230f5cf2a395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f55751-fe07-42d3-a620-230f5cf2a395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48d2d9f-51ed-4793-a5b8-4d42536d733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48d2d9f-51ed-4793-a5b8-4d42536d733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91232adf-ade8-458a-b2a0-e1f6cfe0d1a4', 'volume_name': 'volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f72bf6a-25aa-4ff5-9ad9-29c0307a7b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f72bf6a-25aa-4ff5-9ad9-29c0307a7b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fa3965-9830-46ca-b739-e8bdff27d972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume 91232adf-ade8-458a-b2a0-e1f6cfe0d1a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4', 'volume_size': 1}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "cinder-90e1b443-8bd7-4976-af40-fc1b22523895-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-90e1b443-8bd7-4976-af40-fc1b22523895-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "cinder-quobyte-90e1b443-8bd7-4976-af40-fc1b22523895" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-quobyte-90e1b443-8bd7-4976-af40-fc1b22523895" acquired by "delete_volume" :: waited 0.042s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:55 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (fb2f768e-14ce-46b3-bb33-e4e2df42f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4635639-b425-4198-9467-08c71ac857ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[621b509e-95ee-4082-b293-1648458ecead]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b553f28d-9100-4834-9f70-6870ac5de807 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b" returned: 0 in 1.062s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:55 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b is being set with open permissions: ugo+rw
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4635639-b425-4198-9467-08c71ac857ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096091347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e53bc87-becb-4014-9505-d32295dd9668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:55Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b
Feb 28 01:30:55 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4628e4-933a-447b-8a07-cb4dd61ccfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4628e4-933a-447b-8a07-cb4dd61ccfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3dec3e-2a6c-4e9b-b5e6-6366d3ea616e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3dec3e-2a6c-4e9b-b5e6-6366d3ea616e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e53bc87-becb-4014-9505-d32295dd9668', 'volume_name': 'volume-6e53bc87-becb-4014-9505-d32295dd9668', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc698246-b41d-4f18-b55c-49d9e54e2ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc698246-b41d-4f18-b55c-49d9e54e2ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0126a32b-7c36-4a77-9817-49c79cb8f9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume 6e53bc87-becb-4014-9505-d32295dd9668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e53bc87-becb-4014-9505-d32295dd9668', 'volume_size': 1}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:55 devstack sudo[90266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895
Feb 28 01:30:55 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:55 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.883s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:55 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Deleted volume successfully.
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78fa9a73-5a4e-44c6-9b7c-7e23d2be3cb4 tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-73a4e0fa-ff64-4191-abb1-b6b542ba84bd-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (402f034d-d0b0-4562-b29c-21d1d150eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1572c0c-ef5c-4f51-bc5f-704df3541b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1572c0c-ef5c-4f51-bc5f-704df3541b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-753708690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c671eef-38af-482c-9a79-67582bedc5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:56Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0df1877-4c1a-4c3c-83c7-b42535712877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0df1877-4c1a-4c3c-83c7-b42535712877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1087325b-c5e7-4163-a939-7777276420ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1087325b-c5e7-4163-a939-7777276420ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c671eef-38af-482c-9a79-67582bedc5e1', 'volume_name': 'volume-5c671eef-38af-482c-9a79-67582bedc5e1', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a662a6-7788-47b9-a019-16055aac2761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a662a6-7788-47b9-a019-16055aac2761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e71720-3011-4986-a321-2e4940330957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:55 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume 5c671eef-38af-482c-9a79-67582bedc5e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c671eef-38af-482c-9a79-67582bedc5e1', 'volume_size': 1}
Feb 28 01:30:55 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:56 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b" returned: 0 in 0.693s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:56 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895" returned: 0 in 0.762s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:56 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.info
Feb 28 01:30:56 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:56 devstack sudo[90276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895
Feb 28 01:30:56 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Flow 'volume_create_manager' (4c3b7883-10b5-4b78-b44c-f771aa0db4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02da99d6-d0f0-4fc9-8448-33df73533e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02da99d6-d0f0-4fc9-8448-33df73533e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1360005963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f0383d-5458-456d-9ab2-9edb7c898d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7de5babd33444708f1e78e8d1e470b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:56Z,use_quota=True,user_id='b356255f49214030a1023d64daa5a884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e056ffa7-a0e2-4c76-bd41-4c9b9cec4e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e056ffa7-a0e2-4c76-bd41-4c9b9cec4e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dc1814-b4b0-4e03-b44d-60b9c78b43cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dc1814-b4b0-4e03-b44d-60b9c78b43cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f0383d-5458-456d-9ab2-9edb7c898d02', 'volume_name': 'volume-a8f0383d-5458-456d-9ab2-9edb7c898d02', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a021f320-4690-456c-9da5-0793591f27c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a021f320-4690-456c-9da5-0793591f27c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5120d83-cc26-4758-aa0a-4f9510bb674e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:56 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Volume a8f0383d-5458-456d-9ab2-9edb7c898d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f0383d-5458-456d-9ab2-9edb7c898d02', 'volume_size': 1}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:56 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.info" returned: 0 in 0.419s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:56 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.info is being set with open permissions: ugo+rw
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:56 devstack sudo[90281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.info
Feb 28 01:30:56 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:56 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90e1b443-8bd7-4976-af40-fc1b22523895" returned: 0 in 0.493s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-quobyte-90e1b443-8bd7-4976-af40-fc1b22523895" released by "delete_volume" :: held 1.326s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Created reservations ['6989a0ee-07a7-438e-b96b-26aaba69d43b', 'cbfb784f-56a9-48ce-9d3d-47c2e9a34e93', '79d2c70b-08f7-49fd-87b9-75776444c127', 'd2808505-1f2c-4f51-9612-56354e016f12'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:56 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:56 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:56 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.info" returned: 0 in 0.434s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.079s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.556s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813413849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc96d06-2097-4c1d-aff5-b983a27a9a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:54Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Creating volume 4fc96d06-2097-4c1d-aff5-b983a27a9a8e {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:56 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:56 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:57 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e 1073741824
Feb 28 01:30:57 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:57 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-9bf05642-4cf6-4f24-b5c7-889080d9c798 tempest-VolumeDependencyTests-579031880 None] Create snapshot completed successfully
Feb 28 01:30:57 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.409s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:57 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Deleted volume successfully.
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-caee5ca5-d6e1-463d-bc0b-39790943ad3d tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-90e1b443-8bd7-4976-af40-fc1b22523895-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "cinder-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Flow 'volume_create_manager' (1d2a2e57-bfe9-4379-ada4-710cd7502431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669c9695-505d-41a1-98cd-a4b12afd5c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669c9695-505d-41a1-98cd-a4b12afd5c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1663880090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636983c5-f0ec-4210-a85e-568cf266fc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2294abd465784e5fb8486e7543be4874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=362c0f52-ea79-42d7-826d-706c41bbef1b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:57Z,use_quota=True,user_id='9b96cce48f1243888c60fddb36467e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faa9a1b-9b6e-4ea7-a749-312af21f5325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faa9a1b-9b6e-4ea7-a749-312af21f5325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678adfdc-bb11-4bc6-b43a-d0a8060e1f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678adfdc-bb11-4bc6-b43a-d0a8060e1f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '636983c5-f0ec-4210-a85e-568cf266fc6b', 'volume_name': 'volume-636983c5-f0ec-4210-a85e-568cf266fc6b', 'volume_size': 1, 'snapshot_id': '362c0f52-ea79-42d7-826d-706c41bbef1b'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1b9261-956c-4fd4-96e7-d5442a84f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1b9261-956c-4fd4-96e7-d5442a84f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc405ae-50aa-4e1c-88b2-8204d3491915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:57 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Volume 636983c5-f0ec-4210-a85e-568cf266fc6b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-636983c5-f0ec-4210-a85e-568cf266fc6b', 'volume_size': 1, 'snapshot_id': '362c0f52-ea79-42d7-826d-706c41bbef1b'}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "cinder-quobyte-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-quobyte-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9860b800-aa2d-4246-976f-d16ffd40c643]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:57 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e 1073741824" returned: 0 in 0.563s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:57 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e
Feb 28 01:30:57 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:57 devstack sudo[90294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7
Feb 28 01:30:57 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:57 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e" returned: 0 in 0.405s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.229s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571161942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423fa65b-b6e8-41d3-a4e3-decce8c5c166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:55Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Creating volume 423fa65b-b6e8-41d3-a4e3-decce8c5c166 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:57 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:58 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9bb047-f3a8-4c46-ab3b-8605e7a173f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded8cac6-cdbb-4778-93dc-b7b6c99a823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:58 devstack sudo[90302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166 1073741824
Feb 28 01:30:58 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:58 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e (4fc96d06-2097-4c1d-aff5-b983a27a9a8e): created successfully
Feb 28 01:30:58 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded8cac6-cdbb-4778-93dc-b7b6c99a823c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (2f52b6f8-1554-4b84-a292-f4fb7fc829e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7" returned: 0 in 0.488s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:58 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-be925380-2412-4090-b31d-34b7835e21ff tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created volume successfully.
Feb 28 01:30:58 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7
Feb 28 01:30:58 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:58 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7" returned: 0 in 0.424s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-quobyte-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7" released by "delete_volume" :: held 0.932s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:58 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166 1073741824" returned: 0 in 0.485s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Created reservations ['b8d068b1-22f1-43db-9fdf-6aa34ba99cac', '740f4ac2-465a-46d1-817e-6956b53b5289', 'a716bfeb-414a-41c2-99d4-84faa47f5c7c', '9f8ef430-73af-4a8a-81e1-653b2a1b96eb'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:58 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166
Feb 28 01:30:58 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:58 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:30:58 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:58 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166" returned: 0 in 0.401s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.836s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2089351663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91232adf-ade8-458a-b2a0-e1f6cfe0d1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:55Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Creating volume 91232adf-ade8-458a-b2a0-e1f6cfe0d1a4 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:58 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d3bca9-bf4f-445e-8c0d-bf1dddacebb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1225c6f6-441b-4618-85a3-525968bac96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:58 devstack sudo[90316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4 1073741824
Feb 28 01:30:58 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:58 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166 (423fa65b-b6e8-41d3-a4e3-decce8c5c166): created successfully
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1225c6f6-441b-4618-85a3-525968bac96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:58 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (41006f4a-c642-49f6-b48d-628b8380e88a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:58 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3b065cad-f640-4877-adf0-7f717221f507 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created volume successfully.
Feb 28 01:30:59 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.430s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:30:59 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Deleted volume successfully.
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-63564f9c-b9cd-490c-b822-60cd6c86473b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-8eb09e1d-da94-4a3b-93b9-ddee0bdaa1b7-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:30:59 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4 1073741824" returned: 0 in 0.484s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:59 devstack sudo[90321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4
Feb 28 01:30:59 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "cinder-4c9ef954-b445-4c01-bdd6-43c37a305575-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-4c9ef954-b445-4c01-bdd6-43c37a305575-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "cinder-quobyte-4c9ef954-b445-4c01-bdd6-43c37a305575" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-quobyte-4c9ef954-b445-4c01-bdd6-43c37a305575" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9b3f9e-1ed1-429e-9b2c-69f8f6b13b7f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:59 devstack sudo[90323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575
Feb 28 01:30:59 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:59 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4" returned: 0 in 0.422s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.342s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096091347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e53bc87-becb-4014-9505-d32295dd9668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:55Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Creating volume 6e53bc87-becb-4014-9505-d32295dd9668 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:30:59 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fa3965-9830-46ca-b739-e8bdff27d972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6dd173d-bcf2-4b62-aa3b-5cba30b882b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:30:59 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4 (91232adf-ade8-458a-b2a0-e1f6cfe0d1a4): created successfully
Feb 28 01:30:59 devstack sudo[90326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668 1073741824
Feb 28 01:30:59 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6dd173d-bcf2-4b62-aa3b-5cba30b882b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:30:59 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (fc5ab155-0b30-4ad3-9a9e-2a391a393b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:30:59 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2142d9d8-b0cc-43ac-b62b-2ade800e26d5 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created volume successfully.
Feb 28 01:31:00 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575" returned: 0 in 0.470s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:00 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575
Feb 28 01:31:00 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:00 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668 1073741824" returned: 0 in 0.489s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=123,cinder:INSERT=40,cinder:UPDATE=166,cinder:DELETE=9 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:00 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668
Feb 28 01:31:00 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:00 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4c9ef954-b445-4c01-bdd6-43c37a305575" returned: 0 in 0.402s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-quobyte-4c9ef954-b445-4c01-bdd6-43c37a305575" released by "delete_volume" :: held 0.905s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Created reservations ['3582ec99-d4e7-47b1-93a6-bde5ae1799a9', 'a6226d4c-6feb-4b11-9f48-1f13167da0a3', '0aabb014-77c8-4308-8db1-0addf7a107fe', '7949549a-2e31-48f0-8e84-728562dac6b0'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:00 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:00 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:00 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668" returned: 0 in 0.454s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.981s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-753708690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c671eef-38af-482c-9a79-67582bedc5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2843d484a1f24bab9448ff5d67d4dbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:56Z,use_quota=True,user_id='de4191f1e6f9427e8bd47c60af0018a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Creating volume 5c671eef-38af-482c-9a79-67582bedc5e1 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:00 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0126a32b-7c36-4a77-9817-49c79cb8f9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e53bc87-becb-4014-9505-d32295dd9668', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ef46b6-8529-4665-9c4e-80c36e9ce0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:00 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1 1073741824
Feb 28 01:31:00 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:00 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume volume-6e53bc87-becb-4014-9505-d32295dd9668 (6e53bc87-becb-4014-9505-d32295dd9668): created successfully
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ef46b6-8529-4665-9c4e-80c36e9ce0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:00 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (fb2f768e-14ce-46b3-bb33-e4e2df42f100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:00 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-a9ce2c9a-0f37-474f-a08c-d414466e3481 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created volume successfully.
Feb 28 01:31:01 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.515s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:01 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Deleted volume successfully.
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-efda80cb-1c78-40f2-ae7e-5a321f67165b tempest-CreateVolumesFromImageTest-1417324467 None] Lock "cinder-4c9ef954-b445-4c01-bdd6-43c37a305575-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:01 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1 1073741824" returned: 0 in 0.558s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:01 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1
Feb 28 01:31:01 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:01 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1" returned: 0 in 0.466s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.558s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1360005963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f0383d-5458-456d-9ab2-9edb7c898d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7de5babd33444708f1e78e8d1e470b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:30:56Z,use_quota=True,user_id='b356255f49214030a1023d64daa5a884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Creating volume a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:01 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e71720-3011-4986-a321-2e4940330957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c671eef-38af-482c-9a79-67582bedc5e1', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:01 devstack sudo[90352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 1073741824
Feb 28 01:31:01 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef99fb8-49d7-49f5-ba57-86d7258e84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:01 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Volume volume-5c671eef-38af-482c-9a79-67582bedc5e1 (5c671eef-38af-482c-9a79-67582bedc5e1): created successfully
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef99fb8-49d7-49f5-ba57-86d7258e84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:01 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Flow 'volume_create_manager' (402f034d-d0b0-4562-b29c-21d1d150eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:01 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-538af11e-83e7-4522-862a-faad70952ef3 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created volume successfully.
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-5c671eef-38af-482c-9a79-67582bedc5e1-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-5c671eef-38af-482c-9a79-67582bedc5e1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-quobyte-5c671eef-38af-482c-9a79-67582bedc5e1" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-5c671eef-38af-482c-9a79-67582bedc5e1" acquired by "delete_volume" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb79b5a-438b-4031-8164-f1e484a20663]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:02 devstack sudo[90354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1
Feb 28 01:31:02 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (21122131-9f9f-4e31-9c6d-8b162ad93812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d483e39f-9671-498c-8a25-f4df781730e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:02 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d483e39f-9671-498c-8a25-f4df781730e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120695794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25dbf95-0fdd-4265-ac62-7bca5823f21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:02Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414dac00-829a-401f-8d71-8980db614535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414dac00-829a-401f-8d71-8980db614535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373829ab-4312-430b-9175-9ac6ecb3914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373829ab-4312-430b-9175-9ac6ecb3914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd25dbf95-0fdd-4265-ac62-7bca5823f21f', 'volume_name': 'volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea56506-c0cf-4810-ade8-5611fb31d635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea56506-c0cf-4810-ade8-5611fb31d635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517a91e8-922c-49d7-ad57-e3d93c6ab02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:02 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume d25dbf95-0fdd-4265-ac62-7bca5823f21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f', 'volume_size': 1}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 1073741824" returned: 0 in 0.634s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:02 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02
Feb 28 01:31:02 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:02 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:02 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1
Feb 28 01:31:02 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:02 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02" returned: 0 in 0.402s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.456s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:02 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-quobyte-362c0f52-ea79-42d7-826d-706c41bbef1b-636983c5-f0ec-4210-a85e-568cf266fc6b" by "_create_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5120d83-cc26-4758-aa0a-4f9510bb674e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f0383d-5458-456d-9ab2-9edb7c898d02', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0464effc-de6c-4e6a-8f25-cdee85368cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:03 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Volume volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 (a8f0383d-5458-456d-9ab2-9edb7c898d02): created successfully
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0464effc-de6c-4e6a-8f25-cdee85368cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Flow 'volume_create_manager' (4c3b7883-10b5-4b78-b44c-f771aa0db4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-362c0f52-ea79-42d7-826d-706c41bbef1b-636983c5-f0ec-4210-a85e-568cf266fc6b" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Creating volume 636983c5-f0ec-4210-a85e-568cf266fc6b from snapshot 362c0f52-ea79-42d7-826d-706c41bbef1b {{(pid=82470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-quobyte-636983c5-f0ec-4210-a85e-568cf266fc6b" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=109,cinder:UPDATE=138,cinder:INSERT=28,cinder:DELETE=19 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:31:03 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2d05e039-9fe4-452a-885d-429c2009b4c4 tempest-SnapshotDependencyTests-1909543081 None] Created volume successfully.
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-636983c5-f0ec-4210-a85e-568cf266fc6b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] snapshot: 362c0f52-ea79-42d7-826d-706c41bbef1b, volume: 636983c5-f0ec-4210-a85e-568cf266fc6b,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[786bf1bf-1c31-499a-8ca2-0b3c85e7bc2e]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:03 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b
Feb 28 01:31:03 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:03 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-5c671eef-38af-482c-9a79-67582bedc5e1" returned: 0 in 0.397s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-5c671eef-38af-482c-9a79-67582bedc5e1" released by "delete_volume" :: held 0.945s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created reservations ['6cd6c8c6-8c9e-4bdf-9117-4a45af0fb0e6', 'd7b3d8d4-5a51-43be-82e8-8b97ef1b7e5e', '056e1ee5-ca59-4551-b902-66c30496a276', 'c0645764-d91b-41c1-a1a9-b4b3cff97313'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:03 devstack sudo[90370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:03 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-6e53bc87-becb-4014-9505-d32295dd9668-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-6e53bc87-becb-4014-9505-d32295dd9668-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-quobyte-6e53bc87-becb-4014-9505-d32295dd9668" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-6e53bc87-becb-4014-9505-d32295dd9668" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5cf69e-c188-4386-aed8-71351982fdee]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:03 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668
Feb 28 01:31:03 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:03 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b" returned: 0 in 0.504s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b553f28d-9100-4834-9f70-6870ac5de807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2507cd-0f10-4044-b0dc-4b253df146dc]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:03 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807
Feb 28 01:31:03 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:03 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.469s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:03 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Deleted volume successfully.
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3a576646-98dd-4c62-8813-971cf87c8c3c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-5c671eef-38af-482c-9a79-67582bedc5e1-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:03 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668" returned: 0 in 0.534s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:03 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:03 devstack sudo[90383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668
Feb 28 01:31:03 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:04 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807" returned: 0 in 0.544s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:04 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b
Feb 28 01:31:04 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:04 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6e53bc87-becb-4014-9505-d32295dd9668" returned: 0 in 0.406s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-6e53bc87-becb-4014-9505-d32295dd9668" released by "delete_volume" :: held 0.962s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created reservations ['23c455e0-ec53-4cf8-a21c-5df23f58f095', 'ac4e6023-72ad-4335-ab37-9932b878a476', 'ec3cf79c-decb-48f5-aecb-81c45b7018f2', 'b7dae2e5-d554-4dca-83be-36ddb4c70d4c'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:04 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:04 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-quobyte-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e350f20-0811-4705-8d3e-c209cb3e8e6f]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:04 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:04 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4
Feb 28 01:31:04 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:05 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:05 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 1.124s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:05 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:05 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Deleted volume successfully.
Feb 28 01:31:05 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-7dfd47bf-bf5b-494b-90c0-d558ff859ee2 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-6e53bc87-becb-4014-9505-d32295dd9668-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:06 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4" returned: 0 in 1.581s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:06 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4
Feb 28 01:31:06 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:06 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b" returned: 0 in 2.160s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[02557e8b-931e-4e1c-8ca4-a09b221c4ada]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:06 devstack sudo[90411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807
Feb 28 01:31:06 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:06 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4" released by "delete_volume" :: held 2.071s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created reservations ['605d7a1a-7794-4843-b3fa-fad26668416a', 'f58d1212-6c36-4281-90fc-2ebb4e31b483', '3202d64b-9696-4736-b5b6-23992fceb5d7', '4452e36d-59ac-4ba7-9eb7-7fa862956907'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:06 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:06 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-423fa65b-b6e8-41d3-a4e3-decce8c5c166-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-423fa65b-b6e8-41d3-a4e3-decce8c5c166-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-quobyte-423fa65b-b6e8-41d3-a4e3-decce8c5c166" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-423fa65b-b6e8-41d3-a4e3-decce8c5c166" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9abbee-63db-48f0-b025-1350b15d7ef1]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:06 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166
Feb 28 01:31:06 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:06 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807" returned: 0 in 0.626s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:31:06 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Converted 1024.00 MB image at 473.88 MB/s
Feb 28 01:31:06 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b is being set with open permissions: ugo+rw
Feb 28 01:31:06 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:06 devstack sudo[90421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b
Feb 28 01:31:06 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:07 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.495s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:07 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Deleted volume successfully.
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-597eea3a-5ff6-49ad-8b58-c91387c661ef tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-91232adf-ade8-458a-b2a0-e1f6cfe0d1a4-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:07 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166" returned: 0 in 0.486s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:07 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166
Feb 28 01:31:07 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:07 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b" returned: 0 in 0.450s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-636983c5-f0ec-4210-a85e-568cf266fc6b" released by "_copy_volume_from_snapshot" :: held 4.346s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-362c0f52-ea79-42d7-826d-706c41bbef1b-636983c5-f0ec-4210-a85e-568cf266fc6b" released by "_create_volume_from_snapshot" :: held 4.375s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.408s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.845s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120695794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25dbf95-0fdd-4265-ac62-7bca5823f21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:02Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Creating volume d25dbf95-0fdd-4265-ac62-7bca5823f21f {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:07 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:07 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f 1073741824
Feb 28 01:31:07 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc405ae-50aa-4e1c-88b2-8204d3491915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636983c5-f0ec-4210-a85e-568cf266fc6b', 'volume_size': 1, 'snapshot_id': '362c0f52-ea79-42d7-826d-706c41bbef1b'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6489be-3b47-4ffd-ba11-7e31262f151d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:07 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Volume volume-636983c5-f0ec-4210-a85e-568cf266fc6b (636983c5-f0ec-4210-a85e-568cf266fc6b): created successfully
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6489be-3b47-4ffd-ba11-7e31262f151d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Flow 'volume_create_manager' (1d2a2e57-bfe9-4379-ada4-710cd7502431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:07 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1a6d2d74-17d4-43ef-8aaf-76cdeecf0ca1 tempest-VolumeDependencyTests-579031880 None] Created volume successfully.
Feb 28 01:31:07 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-423fa65b-b6e8-41d3-a4e3-decce8c5c166" returned: 0 in 0.426s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-423fa65b-b6e8-41d3-a4e3-decce8c5c166" released by "delete_volume" :: held 0.941s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created reservations ['6b6a89c9-c655-4e4b-80bd-feba33e6dfe5', 'c8fefa20-1ce4-4036-a0f9-ef41c0b9bc03', '52cba580-9c7d-4be5-864b-27df7b7104de', 'cc43c994-e786-4d59-8ec7-e5c2a09fbcc7'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:07 devstack sudo[90436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:07 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:07 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-4fc96d06-2097-4c1d-aff5-b983a27a9a8e-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f 1073741824" returned: 0 in 0.509s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-4fc96d06-2097-4c1d-aff5-b983a27a9a8e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-quobyte-4fc96d06-2097-4c1d-aff5-b983a27a9a8e" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:07 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-4fc96d06-2097-4c1d-aff5-b983a27a9a8e" acquired by "delete_volume" :: waited 0.019s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7cc284-496c-47a4-adbb-f9a9fa9585fd]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:08 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f
Feb 28 01:31:08 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:08 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e
Feb 28 01:31:08 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-362c0f52-ea79-42d7-826d-706c41bbef1b-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-362c0f52-ea79-42d7-826d-706c41bbef1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-quobyte-b553f28d-9100-4834-9f70-6870ac5de807" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-b553f28d-9100-4834-9f70-6870ac5de807" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-quobyte-362c0f52-ea79-42d7-826d-706c41bbef1b" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-362c0f52-ea79-42d7-826d-706c41bbef1b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Deleting offline snapshot 362c0f52-ea79-42d7-826d-706c41bbef1b of volume b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] snapshot_file for this snap is: volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3570db06-f533-4d8f-9f4d-4fc329329da5]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:08 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:08 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Deleted volume successfully.
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-8bb5ea0c-5aee-4fc8-badd-482f7469df5c tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-423fa65b-b6e8-41d3-a4e3-decce8c5c166-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:08 devstack sudo[90443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b
Feb 28 01:31:08 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:08 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f" returned: 0 in 0.461s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.609s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517a91e8-922c-49d7-ad57-e3d93c6ab02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cccfca-0be6-4221-b23c-b501966fd94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:08 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f (d25dbf95-0fdd-4265-ac62-7bca5823f21f): created successfully
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cccfca-0be6-4221-b23c-b501966fd94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (21122131-9f9f-4e31-9c6d-8b162ad93812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:08 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-67807d81-64c8-4132-b116-e0c581c0d30d tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created volume successfully.
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Creating offline snapshot ad231cc4-565e-427c-bcc9-f584089c9951 of volume a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9bc5d3-c81c-437a-aa67-20e0cbaea802]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:08 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e" returned: 0 in 0.551s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:08 devstack sudo[90449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02
Feb 28 01:31:08 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:08 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e
Feb 28 01:31:08 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:08 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b" returned: 0 in 0.499s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b553f28d-9100-4834-9f70-6870ac5de807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1b4bdb-ba79-4b5d-916c-1a9c735c346c]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:08 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:08 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807
Feb 28 01:31:08 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:09 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02" returned: 0 in 0.550s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:09 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4fc96d06-2097-4c1d-aff5-b983a27a9a8e" returned: 0 in 0.508s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-4fc96d06-2097-4c1d-aff5-b983a27a9a8e" released by "delete_volume" :: held 1.085s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:09 devstack sudo[90462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 1G
Feb 28 01:31:09 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created reservations ['f420a6f9-1893-4121-8025-ef5182eeb7e3', 'b4476c3f-1500-4a62-b4d1-b5c6d22f6459', '6993e128-b28d-45e3-9c69-164505fa9ca2', '52166765-7ed5-460b-b64b-2bb7429e2bd7'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:09 devstack sudo[90464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:09 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (01637757-1ab0-4d3f-a8b6-25353772e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819d6d51-67e7-4c7a-93e5-a61f8ac9586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819d6d51-67e7-4c7a-93e5-a61f8ac9586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673030168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83db37c5-334a-4c54-8d24-688061a860d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:09Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015bfdaa-d084-4c05-af00-87c8bdac895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015bfdaa-d084-4c05-af00-87c8bdac895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa1f769-e59e-41e9-a98c-d494925ab6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa1f769-e59e-41e9-a98c-d494925ab6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83db37c5-334a-4c54-8d24-688061a860d1', 'volume_name': 'volume-83db37c5-334a-4c54-8d24-688061a860d1', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42b0fce-e1a1-461c-b979-0b5e51bb6d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42b0fce-e1a1-461c-b979-0b5e51bb6d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c9854c-c863-43a8-aa80-25f898d80d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume 83db37c5-334a-4c54-8d24-688061a860d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83db37c5-334a-4c54-8d24-688061a860d1', 'volume_size': 1}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (fcc298d6-79fc-46af-a0c9-9e032171b5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca3d82b-5feb-4f07-8236-d1ca85df817e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca3d82b-5feb-4f07-8236-d1ca85df817e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-800366967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d141a82-5b13-448d-b804-b27b4e3abc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:09Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd8b2ab-ee12-452d-9422-dca72c391aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd8b2ab-ee12-452d-9422-dca72c391aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f789aa-fb54-43a9-ae07-9e1ea8e309d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f789aa-fb54-43a9-ae07-9e1ea8e309d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d141a82-5b13-448d-b804-b27b4e3abc59', 'volume_name': 'volume-2d141a82-5b13-448d-b804-b27b4e3abc59', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c88d39-b521-4697-bb3a-62e3a0ae1934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c88d39-b521-4697-bb3a-62e3a0ae1934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378b9159-4add-4bd5-9fee-5438c784bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume 2d141a82-5b13-448d-b804-b27b4e3abc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d141a82-5b13-448d-b804-b27b4e3abc59', 'volume_size': 1}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807" returned: 0 in 0.656s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:09 devstack sudo[90469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b
Feb 28 01:31:09 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (5a671596-0ba1-4272-b128-f2f1b38a61b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f710ef5-cc5f-4d9e-bfac-43094b5fa8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f710ef5-cc5f-4d9e-bfac-43094b5fa8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987971830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:10Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9666eca5-fb9e-4835-86be-00e13c0c8344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9666eca5-fb9e-4835-86be-00e13c0c8344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c432a71-1ba6-4674-a6ec-cf2bdf1d55e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c432a71-1ba6-4674-a6ec-cf2bdf1d55e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb', 'volume_name': 'volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b6dcf7-c115-4ff2-bded-22e8d8e5841b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b6dcf7-c115-4ff2-bded-22e8d8e5841b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a7aa1f-4bb9-4159-8c4d-2c75f0a19d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume 14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb', 'volume_size': 1}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:09 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.533s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:09 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Deleted volume successfully.
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-b9310ea9-9eba-47a8-a303-8628626f2e79 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-4fc96d06-2097-4c1d-aff5-b983a27a9a8e-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (d2a69f8d-24d9-43e2-b245-199f05c8f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b68889-12b5-4ba8-908d-66c9ffefe2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 1G" returned: 0 in 0.719s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:09 devstack sudo[90475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951
Feb 28 01:31:09 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b68889-12b5-4ba8-908d-66c9ffefe2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1403509737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3601ba-3792-4fa7-b16c-1a674b2cb50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:10Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678e58f0-a823-4889-bc54-2c857f77aa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678e58f0-a823-4889-bc54-2c857f77aa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec0ab79-47c1-4817-a8bc-82665336012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec0ab79-47c1-4817-a8bc-82665336012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3601ba-3792-4fa7-b16c-1a674b2cb50e', 'volume_name': 'volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf53601d-45c4-4a32-a931-3f30c677d46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf53601d-45c4-4a32-a931-3f30c677d46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4f524f-15e9-4f5a-bb2a-58ab7791d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume 6b3601ba-3792-4fa7-b16c-1a674b2cb50e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e', 'volume_size': 1}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (1a5316d5-7d5c-40d7-8329-74e3d303a02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2181d469-6650-48c4-8bb9-e13b2a322237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2181d469-6650-48c4-8bb9-e13b2a322237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1015257412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eaa09c5-75b4-4033-a17a-561f211bc047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:10Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3166558-abbe-467c-975c-708a6874ad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3166558-abbe-467c-975c-708a6874ad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272f2458-bf21-4fbd-8ffe-57fc2f0f1e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272f2458-bf21-4fbd-8ffe-57fc2f0f1e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eaa09c5-75b4-4033-a17a-561f211bc047', 'volume_name': 'volume-8eaa09c5-75b4-4033-a17a-561f211bc047', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e439fd-fd62-49b0-a2f4-e7a62f3fa1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:09 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e439fd-fd62-49b0-a2f4-e7a62f3fa1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91dd8fe2-4962-48e3-aa25-b37eb65c13ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:10 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume 8eaa09c5-75b4-4033-a17a-561f211bc047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eaa09c5-75b4-4033-a17a-561f211bc047', 'volume_size': 1}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-568ffdf5-c60f-4db4-8844-c0c96bb4eb52-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-568ffdf5-c60f-4db4-8844-c0c96bb4eb52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-quobyte-89f672b0-7119-4593-82a6-6bcf7487496e" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-89f672b0-7119-4593-82a6-6bcf7487496e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-quobyte-568ffdf5-c60f-4db4-8844-c0c96bb4eb52" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-568ffdf5-c60f-4db4-8844-c0c96bb4eb52" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Deleting offline snapshot 568ffdf5-c60f-4db4-8844-c0c96bb4eb52 of volume 89f672b0-7119-4593-82a6-6bcf7487496e {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] snapshot_file for this snap is: volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdff4e9-68d9-4441-ab3c-62bba7f9605c]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:10 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b" returned: 0 in 0.736s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:10 devstack sudo[90484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b
Feb 28 01:31:10 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:10 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951" returned: 0 in 0.460s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:10 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 is being set with open permissions: ugo+rw
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:10 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52
Feb 28 01:31:10 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:10 devstack sudo[90487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951
Feb 28 01:31:10 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:10 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807.362c0f52-ea79-42d7-826d-706c41bbef1b" returned: 0 in 0.421s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-362c0f52-ea79-42d7-826d-706c41bbef1b" released by "_delete_snapshot" :: held 2.365s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-b553f28d-9100-4834-9f70-6870ac5de807" released by "delete_snapshot" :: held 2.376s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:10 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52" returned: 0 in 0.472s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89f672b0-7119-4593-82a6-6bcf7487496e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7435ca-d330-4df6-877d-02329a329ceb]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:10 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951" returned: 0 in 0.436s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:10 devstack sudo[90495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.info
Feb 28 01:31:10 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Created reservations ['477f3bda-5216-4635-b604-1976154527bb', '3502c240-1cf5-4741-9a3c-223b9580e096', '7a8cefd7-1de1-43c6-b5b9-e9bb9f0fca30', '1bcd01fe-a276-4bd1-8519-1f7391c04343'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:10 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e
Feb 28 01:31:10 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:10 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Delete snapshot completed successfully.
Feb 28 01:31:10 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-af294eaf-f588-47e2-ab21-aa0503e86359 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-362c0f52-ea79-42d7-826d-706c41bbef1b-delete_snapshot" released by "delete_snapshot" :: held 2.518s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:11 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e" returned: 0 in 0.456s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:11 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.info" returned: 0 in 0.423s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:11 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.info is being set with open permissions: ugo+rw
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:11 devstack sudo[90502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52
Feb 28 01:31:11 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:11 devstack sudo[90503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.info
Feb 28 01:31:11 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-b553f28d-9100-4834-9f70-6870ac5de807-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Lock "cinder-b553f28d-9100-4834-9f70-6870ac5de807-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-quobyte-b553f28d-9100-4834-9f70-6870ac5de807" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-b553f28d-9100-4834-9f70-6870ac5de807" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14552cb-b04b-4779-8b05-a0a557c799c6]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:11 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807
Feb 28 01:31:11 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:11 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:11 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.info" returned: 0 in 0.439s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.135s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.246s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673030168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83db37c5-334a-4c54-8d24-688061a860d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:09Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Creating volume 83db37c5-334a-4c54-8d24-688061a860d1 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:11 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52" returned: 0 in 0.494s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:11 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:11 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1 1073741824
Feb 28 01:31:11 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:11 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-bb89cb5a-55ba-40d2-8bd4-719ab9cac614 tempest-SnapshotDependencyTests-1909543081 None] Create snapshot completed successfully
Feb 28 01:31:11 devstack sudo[90513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52
Feb 28 01:31:11 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:12 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807" returned: 0 in 0.545s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:12 devstack sudo[90524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807
Feb 28 01:31:12 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:12 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1 1073741824" returned: 0 in 0.462s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:12 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e.568ffdf5-c60f-4db4-8844-c0c96bb4eb52" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-568ffdf5-c60f-4db4-8844-c0c96bb4eb52" released by "_delete_snapshot" :: held 1.938s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-89f672b0-7119-4593-82a6-6bcf7487496e" released by "delete_snapshot" :: held 1.968s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:12 devstack sudo[90526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1
Feb 28 01:31:12 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created reservations ['c72ec30f-c6cd-49f1-af03-0d793cf5a5b5', '168f3bfc-3756-44af-870c-f7eae5c11111', 'a10f31fe-81d9-4533-b2d1-ff8a29b9be6b', '049528ef-b9fe-4578-8527-e4b94e30aad1'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:12 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Delete snapshot completed successfully.
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-e7f9c342-2a31-4385-aa0e-11a6442f0512 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-568ffdf5-c60f-4db4-8844-c0c96bb4eb52-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-89f672b0-7119-4593-82a6-6bcf7487496e-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-89f672b0-7119-4593-82a6-6bcf7487496e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "cinder-quobyte-89f672b0-7119-4593-82a6-6bcf7487496e" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-89f672b0-7119-4593-82a6-6bcf7487496e" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12c5b9e-bfa0-4358-9e43-6b671d6ed126]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:12 devstack sudo[90528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e
Feb 28 01:31:12 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:12 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-b553f28d-9100-4834-9f70-6870ac5de807" returned: 0 in 0.478s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-b553f28d-9100-4834-9f70-6870ac5de807" released by "delete_volume" :: held 1.062s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:12 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1" returned: 0 in 0.425s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.087s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-800366967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d141a82-5b13-448d-b804-b27b4e3abc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:09Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Creating volume 2d141a82-5b13-448d-b804-b27b4e3abc59 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:12 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c9854c-c863-43a8-aa80-25f898d80d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83db37c5-334a-4c54-8d24-688061a860d1', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:12 devstack sudo[90532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59 1073741824
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c627c7e-9d4b-493b-8b3f-df0c89ac5bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:12 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:12 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume volume-83db37c5-334a-4c54-8d24-688061a860d1 (83db37c5-334a-4c54-8d24-688061a860d1): created successfully
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c627c7e-9d4b-493b-8b3f-df0c89ac5bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (01637757-1ab0-4d3f-a8b6-25353772e612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:12 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-95b0b829-a469-41ec-bc6b-8de4388bcfb8 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created volume successfully.
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Created reservations ['8bc85d49-3a35-4646-9cba-47a0e3dfe4d3', '54012a4b-3ef0-4e46-89c1-bae4f76f4bcc', '2d034307-37b4-4d4c-933b-6ff982cfb211', '8a4c5026-e9a6-4607-bb5c-0f42daf51cce'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Flow 'volume_create_manager' (ab3caa0b-83ee-479c-aefb-e54a9ce82e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:12 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:12 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9a5c92-8791-4750-b371-0b8ea737abc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9a5c92-8791-4750-b371-0b8ea737abc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b43d904-0663-4d38-929b-2f68976f8c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7de5babd33444708f1e78e8d1e470b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad231cc4-565e-427c-bcc9-f584089c9951,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:13Z,use_quota=True,user_id='b356255f49214030a1023d64daa5a884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4cd872-3a2c-4929-b131-0994f9538472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4cd872-3a2c-4929-b131-0994f9538472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a63858c-7f31-4ade-ae61-2b6cafc7f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a63858c-7f31-4ade-ae61-2b6cafc7f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b43d904-0663-4d38-929b-2f68976f8c6b', 'volume_name': 'volume-4b43d904-0663-4d38-929b-2f68976f8c6b', 'volume_size': 1, 'snapshot_id': 'ad231cc4-565e-427c-bcc9-f584089c9951'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6dc4a0-46f4-476f-aa02-795c5c8897ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6dc4a0-46f4-476f-aa02-795c5c8897ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7d7e0d-7e2f-4496-a814-920a3045ba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:12 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Volume 4b43d904-0663-4d38-929b-2f68976f8c6b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b43d904-0663-4d38-929b-2f68976f8c6b', 'volume_size': 1, 'snapshot_id': 'ad231cc4-565e-427c-bcc9-f584089c9951'}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:12 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e" returned: 0 in 0.549s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:12 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:12 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e
Feb 28 01:31:12 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:13 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59 1073741824" returned: 0 in 0.500s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:13 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59
Feb 28 01:31:13 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:13 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.482s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:13 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Deleted volume successfully.
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d23af13e-5612-483f-91e0-8d44365b644e tempest-VolumeDependencyTests-579031880 None] Lock "cinder-b553f28d-9100-4834-9f70-6870ac5de807-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:13 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-89f672b0-7119-4593-82a6-6bcf7487496e" returned: 0 in 0.424s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-quobyte-89f672b0-7119-4593-82a6-6bcf7487496e" released by "delete_volume" :: held 1.006s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Created reservations ['3ae45ffe-26db-42f4-8aa8-35474718bd39', '5eb3ab4e-39cf-495c-b073-d07d10deef5f', '6a57af9e-578f-4834-bf41-e53486f6113a', 'f88e8fa7-b63d-492b-81ab-bd2b43f12c86'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:13 devstack sudo[90548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:13 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:13 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59" returned: 0 in 0.425s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.852s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987971830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:10Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Creating volume 14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:13 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378b9159-4add-4bd5-9fee-5438c784bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d141a82-5b13-448d-b804-b27b4e3abc59', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:13 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb 1073741824
Feb 28 01:31:13 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f815a44e-8d56-430b-8446-48ca23dd2f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:13 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume volume-2d141a82-5b13-448d-b804-b27b4e3abc59 (2d141a82-5b13-448d-b804-b27b4e3abc59): created successfully
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f815a44e-8d56-430b-8446-48ca23dd2f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (fcc298d6-79fc-46af-a0c9-9e032171b5bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:13 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-19455aa4-8ffe-4fff-8b34-5dad5a0ef14e tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created volume successfully.
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Flow 'volume_create_manager' (ea689bbd-a2b5-47e2-8a39-f82a1a991b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb35e1fe-de65-43de-b549-0779a4e8b706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb35e1fe-de65-43de-b549-0779a4e8b706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1532585078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af822a74-ea11-4411-83bf-bb8b0a579196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2294abd465784e5fb8486e7543be4874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:14Z,use_quota=True,user_id='9b96cce48f1243888c60fddb36467e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ff70a5-b3cc-43e2-a389-496d72ac82c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ff70a5-b3cc-43e2-a389-496d72ac82c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2638cc4b-397c-4202-854e-38ba3d1e48de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2638cc4b-397c-4202-854e-38ba3d1e48de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af822a74-ea11-4411-83bf-bb8b0a579196', 'volume_name': 'volume-af822a74-ea11-4411-83bf-bb8b0a579196', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0dbfcde-2293-459d-8385-352cdb9efc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0dbfcde-2293-459d-8385-352cdb9efc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de3205-9254-48d2-9a3a-23720a3b6910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:13 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Volume af822a74-ea11-4411-83bf-bb8b0a579196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af822a74-ea11-4411-83bf-bb8b0a579196', 'volume_size': 1}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:13 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:13 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Deleted volume successfully.
Feb 28 01:31:13 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-87e1096d-d0ca-4719-a772-44b37b070023 tempest-CreateVolumesFromSnapshotTest-1270172337 None] Lock "cinder-89f672b0-7119-4593-82a6-6bcf7487496e-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:14 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb 1073741824" returned: 0 in 0.490s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:14 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb
Feb 28 01:31:14 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:14 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb" returned: 0 in 0.430s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.628s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1403509737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3601ba-3792-4fa7-b16c-1a674b2cb50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:10Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Creating volume 6b3601ba-3792-4fa7-b16c-1a674b2cb50e {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:14 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a7aa1f-4bb9-4159-8c4d-2c75f0a19d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:14 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e 1073741824
Feb 28 01:31:14 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d454fc7a-4dab-4964-b5be-01666a2e93f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:14 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb (14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb): created successfully
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d454fc7a-4dab-4964-b5be-01666a2e93f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:14 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (5a671596-0ba1-4272-b128-f2f1b38a61b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:14 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-55e5dcd8-2b72-411c-b483-b7068ce04ea6 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created volume successfully.
Feb 28 01:31:15 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e 1073741824" returned: 0 in 0.569s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:15 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e
Feb 28 01:31:15 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:15 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e" returned: 0 in 0.467s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.527s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1015257412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eaa09c5-75b4-4033-a17a-561f211bc047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601a65e7fee4e1f8c5265193a04a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:10Z,use_quota=True,user_id='cd14552f254847aab0a0da7e896a1be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Creating volume 8eaa09c5-75b4-4033-a17a-561f211bc047 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:15 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4f524f-15e9-4f5a-bb2a-58ab7791d00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:15 devstack sudo[90568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047 1073741824
Feb 28 01:31:15 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d69a31-bb71-451a-898e-f5fef119f752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:15 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e (6b3601ba-3792-4fa7-b16c-1a674b2cb50e): created successfully
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d69a31-bb71-451a-898e-f5fef119f752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:15 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (d2a69f8d-24d9-43e2-b245-199f05c8f607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:15 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-9d7761e9-ad16-4151-917c-52c12a24dedd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created volume successfully.
Feb 28 01:31:16 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047 1073741824" returned: 0 in 0.530s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:16 devstack sudo[90573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047
Feb 28 01:31:16 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Flow 'volume_create_manager' (d890f007-5fef-4ba0-a42c-17daea98e05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f06ec6-96ff-4006-979a-bb9de4d412f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f06ec6-96ff-4006-979a-bb9de4d412f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f006b6-bfab-4919-9036-c49be229e53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ce5a70555e47529c3af851355790bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:16Z,use_quota=True,user_id='d45d132cd3d24fb69a3eb026eaebaf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25eddb9f-ba98-4abd-b367-e8024a8cd524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25eddb9f-ba98-4abd-b367-e8024a8cd524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc79447a-4fed-473a-9714-f0c081fa2f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc79447a-4fed-473a-9714-f0c081fa2f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f006b6-bfab-4919-9036-c49be229e53b', 'volume_name': 'volume-90f006b6-bfab-4919-9036-c49be229e53b', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae327622-b171-4691-a78e-ad426f448ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae327622-b171-4691-a78e-ad426f448ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb48b1fd-5707-4275-b2c6-42c576022d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:16 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Volume 90f006b6-bfab-4919-9036-c49be229e53b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f006b6-bfab-4919-9036-c49be229e53b', 'volume_size': 1}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:16 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047" returned: 0 in 0.407s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.709s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "cinder-quobyte-ad231cc4-565e-427c-bcc9-f584089c9951-4b43d904-0663-4d38-929b-2f68976f8c6b" by "_create_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91dd8fe2-4962-48e3-aa25-b37eb65c13ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eaa09c5-75b4-4033-a17a-561f211bc047', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be5fe69-b675-49c5-adf5-ce3e51e5d7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-ad231cc4-565e-427c-bcc9-f584089c9951-4b43d904-0663-4d38-929b-2f68976f8c6b" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Creating volume 4b43d904-0663-4d38-929b-2f68976f8c6b from snapshot ad231cc4-565e-427c-bcc9-f584089c9951 {{(pid=82470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "cinder-quobyte-4b43d904-0663-4d38-929b-2f68976f8c6b" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:16 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Volume volume-8eaa09c5-75b4-4033-a17a-561f211bc047 (8eaa09c5-75b4-4033-a17a-561f211bc047): created successfully
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be5fe69-b675-49c5-adf5-ce3e51e5d7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Flow 'volume_create_manager' (1a5316d5-7d5c-40d7-8329-74e3d303a02e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-4b43d904-0663-4d38-929b-2f68976f8c6b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] snapshot: ad231cc4-565e-427c-bcc9-f584089c9951, volume: 4b43d904-0663-4d38-929b-2f68976f8c6b,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:31:16 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ef3392b0-ab2b-446f-8c20-d4cb5e3a87dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created volume successfully.
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec25e34-7161-443c-9847-2309beeaabc4]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:16 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:16 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951
Feb 28 01:31:16 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:17 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951" returned: 0 in 0.475s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f0383d-5458-456d-9ab2-9edb7c898d02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ef9b4f-f770-45bd-9200-81d9f52f3bd3]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:17 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02
Feb 28 01:31:17 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:17 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02" returned: 0 in 0.461s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-8eaa09c5-75b4-4033-a17a-561f211bc047-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:17 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b
Feb 28 01:31:17 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-8eaa09c5-75b4-4033-a17a-561f211bc047-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-quobyte-8eaa09c5-75b4-4033-a17a-561f211bc047" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-8eaa09c5-75b4-4033-a17a-561f211bc047" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa4c603-7352-40ac-aa10-411014be65da]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:17 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:17 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047
Feb 28 01:31:17 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:18 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047" returned: 0 in 0.740s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:18 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:18 devstack sudo[90603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047
Feb 28 01:31:18 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:19 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-8eaa09c5-75b4-4033-a17a-561f211bc047" returned: 0 in 1.166s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-8eaa09c5-75b4-4033-a17a-561f211bc047" released by "delete_volume" :: held 1.932s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created reservations ['76705b12-20bf-4b5d-892d-ce4cc5f0e0cc', '06134eb5-2769-4d90-b79a-303813ca652f', '09ceb7d8-24a3-4a37-91ee-acb0ac4bd20f', 'ffcee417-224a-4c38-9c4a-98f956cf3277'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:19 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b" returned: 0 in 2.082s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e196cde-28e7-44aa-86b3-f62b236a15f5]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:19 devstack sudo[90606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:19 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:19 devstack sudo[90607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02
Feb 28 01:31:19 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-6b3601ba-3792-4fa7-b16c-1a674b2cb50e-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-6b3601ba-3792-4fa7-b16c-1a674b2cb50e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-quobyte-6b3601ba-3792-4fa7-b16c-1a674b2cb50e" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-6b3601ba-3792-4fa7-b16c-1a674b2cb50e" acquired by "delete_volume" :: waited 0.016s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f848de8-2ded-4f9e-ac50-160b42b34743]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:19 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:19 devstack sudo[90610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e
Feb 28 01:31:19 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:20 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.416s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Deleted volume successfully.
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5ccb61ab-9784-431f-9153-5d11b4354a87 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-8eaa09c5-75b4-4033-a17a-561f211bc047-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:20 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02" returned: 0 in 0.614s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:31:20 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Converted 1024.00 MB image at 491.03 MB/s
Feb 28 01:31:20 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b is being set with open permissions: ugo+rw
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:20 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b
Feb 28 01:31:20 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:20 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e" returned: 0 in 0.471s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:20 devstack sudo[90621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e
Feb 28 01:31:20 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:20 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b" returned: 0 in 0.398s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-4b43d904-0663-4d38-929b-2f68976f8c6b" released by "_copy_volume_from_snapshot" :: held 4.096s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-ad231cc4-565e-427c-bcc9-f584089c9951-4b43d904-0663-4d38-929b-2f68976f8c6b" released by "_create_volume_from_snapshot" :: held 4.126s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.148s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.742s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1532585078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af822a74-ea11-4411-83bf-bb8b0a579196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2294abd465784e5fb8486e7543be4874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:14Z,use_quota=True,user_id='9b96cce48f1243888c60fddb36467e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Creating volume af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:20 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:20 devstack sudo[90624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 1073741824
Feb 28 01:31:20 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7d7e0d-7e2f-4496-a814-920a3045ba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b43d904-0663-4d38-929b-2f68976f8c6b', 'volume_size': 1, 'snapshot_id': 'ad231cc4-565e-427c-bcc9-f584089c9951'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87675294-8015-4d79-8f9c-370ca0198c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:20 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Volume volume-4b43d904-0663-4d38-929b-2f68976f8c6b (4b43d904-0663-4d38-929b-2f68976f8c6b): created successfully
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87675294-8015-4d79-8f9c-370ca0198c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Flow 'volume_create_manager' (ab3caa0b-83ee-479c-aefb-e54a9ce82e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:20 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-5381edb9-928b-45b0-8230-d2f150305903 tempest-SnapshotDependencyTests-1909543081 None] Created volume successfully.
Feb 28 01:31:20 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-6b3601ba-3792-4fa7-b16c-1a674b2cb50e" returned: 0 in 0.439s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-6b3601ba-3792-4fa7-b16c-1a674b2cb50e" released by "delete_volume" :: held 0.930s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created reservations ['9c819b55-a717-4ddb-be52-2abf5b013851', 'e6e400cf-6b56-4d24-814b-d3c8efa708da', '7b136959-18e0-49ed-b2c1-bb8d76d84153', '3b54625d-948a-4ae4-8d33-4657f1b43153'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:20 devstack sudo[90627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:20 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-quobyte-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f62a61-e40a-4443-8ced-2519103a9235]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:20 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:21 devstack sudo[90629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb
Feb 28 01:31:21 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:21 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 1073741824" returned: 0 in 0.547s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:21 devstack sudo[90635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196
Feb 28 01:31:21 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "cinder-ad231cc4-565e-427c-bcc9-f584089c9951-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-ad231cc4-565e-427c-bcc9-f584089c9951-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "cinder-quobyte-a8f0383d-5458-456d-9ab2-9edb7c898d02" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-a8f0383d-5458-456d-9ab2-9edb7c898d02" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "cinder-quobyte-ad231cc4-565e-427c-bcc9-f584089c9951" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-ad231cc4-565e-427c-bcc9-f584089c9951" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Deleting offline snapshot ad231cc4-565e-427c-bcc9-f584089c9951 of volume a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] snapshot_file for this snap is: volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[90664528-e7b2-48df-8b97-1e22043579bb]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:21 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.487s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:21 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Deleted volume successfully.
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-6af4af2c-fa54-4cbf-b870-159cec329451 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-6b3601ba-3792-4fa7-b16c-1a674b2cb50e-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:21 devstack sudo[90637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951
Feb 28 01:31:21 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:21 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb" returned: 0 in 0.509s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:21 devstack sudo[90642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb
Feb 28 01:31:21 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:21 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196" returned: 0 in 0.459s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.404s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f006b6-bfab-4919-9036-c49be229e53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ce5a70555e47529c3af851355790bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:16Z,use_quota=True,user_id='d45d132cd3d24fb69a3eb026eaebaf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Creating volume 90f006b6-bfab-4919-9036-c49be229e53b {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:21 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de3205-9254-48d2-9a3a-23720a3b6910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af822a74-ea11-4411-83bf-bb8b0a579196', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:21 devstack sudo[90645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b 1073741824
Feb 28 01:31:21 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c325ef9-7d93-40c4-8601-8e15e3d8a8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:21 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Volume volume-af822a74-ea11-4411-83bf-bb8b0a579196 (af822a74-ea11-4411-83bf-bb8b0a579196): created successfully
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c325ef9-7d93-40c4-8601-8e15e3d8a8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Flow 'volume_create_manager' (ea689bbd-a2b5-47e2-8a39-f82a1a991b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:21 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-b364b467-cec7-4467-892e-bf8dc485d50a tempest-VolumeDependencyTests-579031880 None] Created volume successfully.
Feb 28 01:31:21 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951" returned: 0 in 0.525s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f0383d-5458-456d-9ab2-9edb7c898d02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc50901-fc56-4098-bb35-e64213dfeab5]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:21 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb" returned: 0 in 0.424s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb" released by "delete_volume" :: held 0.953s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:21 devstack sudo[90652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02
Feb 28 01:31:21 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created reservations ['dc93a612-442b-4209-9e7c-252517672c78', 'aa06fde1-7006-42f5-ba83-c4c79c1017a6', 'f92241f4-9b1b-4b09-9e1b-63dd3966597f', '6ba11bab-0d76-45a8-9237-f3dc9988ce5a'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:21 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:22 devstack sudo[90654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:22 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-2d141a82-5b13-448d-b804-b27b4e3abc59-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-2d141a82-5b13-448d-b804-b27b4e3abc59-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-quobyte-2d141a82-5b13-448d-b804-b27b4e3abc59" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-2d141a82-5b13-448d-b804-b27b4e3abc59" acquired by "delete_volume" :: waited 0.009s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[894e31e7-13dd-41e7-9ca9-a67a353828d7]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:22 devstack sudo[90659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59
Feb 28 01:31:22 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:22 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b 1073741824" returned: 0 in 0.518s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:22 devstack sudo[90661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b
Feb 28 01:31:22 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:22 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02" returned: 0 in 0.516s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:22 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951
Feb 28 01:31:22 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:22 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.614s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:22 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Deleted volume successfully.
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-c8490077-6080-4564-8886-5cbcdb57019c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-14e4bf2e-e5a9-4e64-9997-98fdc6fd4bdb-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:22 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59" returned: 0 in 0.578s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:22 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b" returned: 0 in 0.440s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:22 devstack sudo[90673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59
Feb 28 01:31:22 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb48b1fd-5707-4275-b2c6-42c576022d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f006b6-bfab-4919-9036-c49be229e53b', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66dce855-98fa-4fa5-95a2-2d7ebcb137be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:22 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Volume volume-90f006b6-bfab-4919-9036-c49be229e53b (90f006b6-bfab-4919-9036-c49be229e53b): created successfully
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66dce855-98fa-4fa5-95a2-2d7ebcb137be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Flow 'volume_create_manager' (d890f007-5fef-4ba0-a42c-17daea98e05b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:22 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-9cde4e1d-31ce-44ea-aa8f-47243d0d3110 tempest-CinderUnicodeTest-7673879 None] Created volume successfully.
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Flow 'volume_create_manager' (38f70700-0bdd-4b9d-83fd-a6c892306305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e9d2fc-96b1-4541-b752-42c5cee3752d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:22 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951" returned: 0 in 0.526s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e9d2fc-96b1-4541-b752-42c5cee3752d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1137468938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c297b9-14f2-400c-9e7f-c33667197a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2294abd465784e5fb8486e7543be4874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=af822a74-ea11-4411-83bf-bb8b0a579196,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:23Z,use_quota=True,user_id='9b96cce48f1243888c60fddb36467e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01b19bf-1866-4e45-b7cc-57ba4ddc9d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:22 devstack sudo[90678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951
Feb 28 01:31:22 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01b19bf-1866-4e45-b7cc-57ba4ddc9d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be0c005-d3bd-43e6-896a-843348462189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be0c005-d3bd-43e6-896a-843348462189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '75c297b9-14f2-400c-9e7f-c33667197a13', 'volume_name': 'volume-75c297b9-14f2-400c-9e7f-c33667197a13', 'volume_size': 1, 'source_volid': 'af822a74-ea11-4411-83bf-bb8b0a579196', 'source_volstatus': 'available'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2cd7f2-549d-4845-ad7f-2dfe73ec0267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2cd7f2-549d-4845-ad7f-2dfe73ec0267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5568e6a4-41e1-4a31-9314-271ac3fd52cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:22 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Volume 75c297b9-14f2-400c-9e7f-c33667197a13: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-75c297b9-14f2-400c-9e7f-c33667197a13', 'volume_size': 1, 'source_volid': 'af822a74-ea11-4411-83bf-bb8b0a579196', 'source_volstatus': 'available'}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:22 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Cloning volume af822a74-ea11-4411-83bf-bb8b0a579196 to volume 75c297b9-14f2-400c-9e7f-c33667197a13
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Creating offline snapshot c11af96a-34db-4dcb-acfe-e9ecdd92dccb of volume af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[554fe42f-aa46-4e46-8d48-be09258d3967]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:22 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:23 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196
Feb 28 01:31:23 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:23 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-2d141a82-5b13-448d-b804-b27b4e3abc59" returned: 0 in 0.458s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-2d141a82-5b13-448d-b804-b27b4e3abc59" released by "delete_volume" :: held 1.058s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created reservations ['ff88b788-7a4d-45e1-9ddb-c0b87dde516a', 'b854f633-4cde-4aaa-a631-a7e530c1ae0f', 'e2f80f4b-57ce-47d0-a014-f29a17c3d165', '7a86984c-55cf-4cd5-9db9-5d60311c1ceb'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:23 devstack sudo[90683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:23 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:23 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02.ad231cc4-565e-427c-bcc9-f584089c9951" returned: 0 in 0.449s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-ad231cc4-565e-427c-bcc9-f584089c9951" released by "_delete_snapshot" :: held 2.068s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-a8f0383d-5458-456d-9ab2-9edb7c898d02" released by "delete_snapshot" :: held 2.079s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Created reservations ['47ce58f7-37e5-42fc-abbd-b051749b842b', 'b1c0642b-de04-4994-9483-019f1e3b5604', '6c026839-7c5f-4536-a137-d55d5c02f269', 'ba2c9da5-860d-489b-9688-b5a129d2931c'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:23 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Delete snapshot completed successfully.
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d36f9229-9ab7-4ecf-85ef-358f93bab04c tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-ad231cc4-565e-427c-bcc9-f584089c9951-delete_snapshot" released by "delete_snapshot" :: held 2.173s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:23 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196" returned: 0 in 0.492s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:23 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb 1G
Feb 28 01:31:23 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:23 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.444s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:23 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Deleted volume successfully.
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-d02cfdc0-fedf-4db4-b2d6-d0e611d36f74 tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-2d141a82-5b13-448d-b804-b27b4e3abc59-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.flows.manager.create_volume [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Flow 'volume_create_manager' (418f0615-fe41-4052-9ef7-ae64fbd7a8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5b3f43-1393-4eb3-aa8c-3c103a30854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5b3f43-1393-4eb3-aa8c-3c103a30854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1855322538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ce5a70555e47529c3af851355790bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:24Z,use_quota=True,user_id='d45d132cd3d24fb69a3eb026eaebaf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c460e22-9e91-43f0-b72f-aa79cad5ff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c460e22-9e91-43f0-b72f-aa79cad5ff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a94298d-d582-43b5-8774-95cc325c380a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a94298d-d582-43b5-8774-95cc325c380a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0', 'volume_name': 'volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1b99e8-e0fb-4ff8-8810-c6b421566469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1b99e8-e0fb-4ff8-8810-c6b421566469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6380a183-889a-4dbe-83bd-591352ed963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:23 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Volume 0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0', 'volume_size': 1}
Feb 28 01:31:23 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:24 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb 1G" returned: 0 in 0.540s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af822a74-ea11-4411-83bf-bb8b0a579196 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:24 devstack sudo[90695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af822a74-ea11-4411-83bf-bb8b0a579196 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb
Feb 28 01:31:24 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-83db37c5-334a-4c54-8d24-688061a860d1-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-83db37c5-334a-4c54-8d24-688061a860d1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-quobyte-83db37c5-334a-4c54-8d24-688061a860d1" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-83db37c5-334a-4c54-8d24-688061a860d1" acquired by "delete_volume" :: waited 0.019s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7f2c36-aa24-4758-a0cd-7b77ce291e35]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:24 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1
Feb 28 01:31:24 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "cinder-a8f0383d-5458-456d-9ab2-9edb7c898d02-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-a8f0383d-5458-456d-9ab2-9edb7c898d02-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "cinder-quobyte-a8f0383d-5458-456d-9ab2-9edb7c898d02" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-a8f0383d-5458-456d-9ab2-9edb7c898d02" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:24 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af822a74-ea11-4411-83bf-bb8b0a579196 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb" returned: 0 in 0.463s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:24 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb is being set with open permissions: ugo+rw
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d523a05-4da0-4346-865e-c8806c9d7cda]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:24 devstack sudo[90702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb
Feb 28 01:31:24 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:24 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02
Feb 28 01:31:24 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:24 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1" returned: 0 in 0.511s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:24 devstack sudo[90710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1
Feb 28 01:31:24 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:24 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb" returned: 0 in 0.399s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:24 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:24 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.info
Feb 28 01:31:24 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:24 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02" returned: 0 in 0.502s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:25 devstack sudo[90717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02
Feb 28 01:31:25 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:25 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-83db37c5-334a-4c54-8d24-688061a860d1" returned: 0 in 0.429s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-83db37c5-334a-4c54-8d24-688061a860d1" released by "delete_volume" :: held 0.963s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created reservations ['7458c26a-090a-451e-adac-63e498702f5d', '7557bd44-40ea-4bf4-bdee-7ed09e2b07c3', '472c925f-e13e-47f8-b8e0-d0e98f6afdef', '3c64d71a-ae38-40bd-af29-ff8e2fc2269c'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:25 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.info" returned: 0 in 0.455s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:25 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.info is being set with open permissions: ugo+rw
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:25 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:25 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-d25dbf95-0fdd-4265-ac62-7bca5823f21f-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-d25dbf95-0fdd-4265-ac62-7bca5823f21f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:25 devstack sudo[90723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.info
Feb 28 01:31:25 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:25 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-a8f0383d-5458-456d-9ab2-9edb7c898d02" returned: 0 in 0.449s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "cinder-quobyte-d25dbf95-0fdd-4265-ac62-7bca5823f21f" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-a8f0383d-5458-456d-9ab2-9edb7c898d02" released by "delete_volume" :: held 0.991s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-d25dbf95-0fdd-4265-ac62-7bca5823f21f" acquired by "delete_volume" :: waited 0.021s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a9655-0ba2-402b-9c36-501b55abe8b3]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Created reservations ['02627338-dde2-43c8-9215-4ea4e022f496', '9151a2b6-fe76-40a9-9a19-0a13be45a072', '4f20bf86-07e0-42dd-861e-8a9ccd593d89', '63593c51-915e-4d35-9c4c-ea2bdd54c6a1'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:25 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:25 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:25 devstack sudo[90726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f
Feb 28 01:31:25 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:25 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.434s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:25 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Deleted volume successfully.
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-336a8f29-6c3a-4ee6-870a-a207e381e4dd tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-83db37c5-334a-4c54-8d24-688061a860d1-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:25 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.info" returned: 0 in 0.518s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-quobyte-75c297b9-14f2-400c-9e7f-c33667197a13" by "_copy_volume_from_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-75c297b9-14f2-400c-9e7f-c33667197a13" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] snapshot: c11af96a-34db-4dcb-acfe-e9ecdd92dccb, volume: 75c297b9-14f2-400c-9e7f-c33667197a13,  {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6feb162-860e-46a2-8fef-9573338ea30c]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:25 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:26 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.446s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:26 devstack sudo[90733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:26 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:26 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Deleted volume successfully.
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-fc63d846-2440-4537-99dc-f350d2af91b2 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-a8f0383d-5458-456d-9ab2-9edb7c898d02-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:26 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f" returned: 0 in 0.568s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:26 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f
Feb 28 01:31:26 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:26 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb" returned: 0 in 0.479s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af822a74-ea11-4411-83bf-bb8b0a579196(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] will copy from snapshot at /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Creating direct copy from snapshot {{(pid=82470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7728fb12-5119-4e5e-bafe-c77f14a8279d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:26 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-d25dbf95-0fdd-4265-ac62-7bca5823f21f" returned: 0 in 0.400s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-quobyte-d25dbf95-0fdd-4265-ac62-7bca5823f21f" released by "delete_volume" :: held 0.993s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:26 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196
Feb 28 01:31:26 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Created reservations ['39ab6f7b-1728-4758-b50c-49266701b00a', '63273a0d-e1e0-40ce-bad7-d3e4d55aa052', '37e896be-fc39-4270-aa54-261482b2c123', 'ec1cf783-d3a8-41e3-b6df-f4db5427e920'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:26 devstack sudo[90746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:26 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "cinder-4b43d904-0663-4d38-929b-2f68976f8c6b-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-4b43d904-0663-4d38-929b-2f68976f8c6b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "cinder-quobyte-4b43d904-0663-4d38-929b-2f68976f8c6b" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-4b43d904-0663-4d38-929b-2f68976f8c6b" acquired by "delete_volume" :: waited 0.006s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6ee6c3-c0d1-4904-b925-1016d8d35d14]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:26 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b
Feb 28 01:31:26 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:26 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196" returned: 0 in 0.499s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG cinder.utils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Path /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13 not found in is_blk_device check {{(pid=82470) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 28 01:31:26 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:26 devstack sudo[90753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13
Feb 28 01:31:26 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:26 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.443s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:27 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:27 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Deleted volume successfully.
Feb 28 01:31:27 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-2b1f75a2-1233-46bd-88d8-63c7e4bb9e0c tempest-CreateVolumesFromSourceVolumeTest-790899503 None] Lock "cinder-d25dbf95-0fdd-4265-ac62-7bca5823f21f-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:27 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b" returned: 0 in 0.478s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:27 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:27 devstack sudo[90759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b
Feb 28 01:31:27 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:28 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-4b43d904-0663-4d38-929b-2f68976f8c6b" returned: 0 in 1.137s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:28 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-quobyte-4b43d904-0663-4d38-929b-2f68976f8c6b" released by "delete_volume" :: held 1.651s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:28 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Created reservations ['7b903773-baef-4103-95c9-fb72d0be7dcb', 'aadb73ba-7beb-4d96-a53e-d5a0657877f5', '9c5d2b71-8a45-4754-80fb-5e4837f6154d', '3a5b0671-4f1f-42dd-a7c2-7a949987c1eb'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:28 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:28 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:28 devstack sudo[90772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:28 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:29 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13" returned: 0 in 2.216s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:29 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9929e7-567f-415a-b8e0-5dc2240234b3]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:29 devstack sudo[90774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196
Feb 28 01:31:29 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:29 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.876s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:29 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:29 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Deleted volume successfully.
Feb 28 01:31:29 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-78a0a346-2648-4637-a6b7-99d7104943e1 tempest-SnapshotDependencyTests-1909543081 None] Lock "cinder-4b43d904-0663-4d38-929b-2f68976f8c6b-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:29 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196" returned: 0 in 0.769s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:29 devstack cinder-volume[82470]: DEBUG cinder.image.image_utils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Image conversion details: src /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13 {{(pid=82470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 28 01:31:29 devstack cinder-volume[82470]: INFO cinder.image.image_utils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Converted 1024.00 MB image at 461.78 MB/s
Feb 28 01:31:29 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13 is being set with open permissions: ugo+rw
Feb 28 01:31:29 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:29 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13
Feb 28 01:31:29 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:30 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13" returned: 0 in 0.454s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-75c297b9-14f2-400c-9e7f-c33667197a13" released by "_copy_volume_from_snapshot" :: held 4.464s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-quobyte-c11af96a-34db-4dcb-acfe-e9ecdd92dccb" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-c11af96a-34db-4dcb-acfe-e9ecdd92dccb" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Deleting offline snapshot c11af96a-34db-4dcb-acfe-e9ecdd92dccb of volume af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] snapshot_file for this snap is: volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[55947595-2269-4de6-855b-fec3ab629c7a]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:30 devstack sudo[90784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb
Feb 28 01:31:30 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:30 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb" returned: 0 in 0.505s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af822a74-ea11-4411-83bf-bb8b0a579196(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b988aba-a22b-4a6d-9e59-ed49e46a4388]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:30 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:30 devstack sudo[90789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196
Feb 28 01:31:30 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:31 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196" returned: 0 in 0.534s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:31 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb
Feb 28 01:31:31 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:31 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb" returned: 0 in 0.488s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:31 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:31 devstack sudo[90801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb
Feb 28 01:31:31 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:32 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196.c11af96a-34db-4dcb-acfe-e9ecdd92dccb" returned: 0 in 0.424s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-c11af96a-34db-4dcb-acfe-e9ecdd92dccb" released by "_delete_snapshot" :: held 2.009s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.461s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.447s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9fc6e3caf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-28T00:31:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1855322538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ce5a70555e47529c3af851355790bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-28T00:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-28T00:31:24Z,use_quota=True,user_id='d45d132cd3d24fb69a3eb026eaebaf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e042e6ca-5e18-4b2b-b7ad-c85294439039),volume_type_id=e042e6ca-5e18-4b2b-b7ad-c85294439039)}" {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Creating volume 0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 {{(pid=82470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Selected osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc as target Quobyte volume. {{(pid=82470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 28 01:31:32 devstack cinder-volume[82470]: INFO cinder.volume.drivers.remotefs [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] casted to osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 1073741824 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5568e6a4-41e1-4a31-9314-271ac3fd52cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c297b9-14f2-400c-9e7f-c33667197a13', 'volume_size': 1, 'source_volid': 'af822a74-ea11-4411-83bf-bb8b0a579196', 'source_volstatus': 'available'}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffd3596-e32d-4789-a214-ca2b494bbdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:32 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 1073741824
Feb 28 01:31:32 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:32 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Volume volume-75c297b9-14f2-400c-9e7f-c33667197a13 (75c297b9-14f2-400c-9e7f-c33667197a13): created successfully
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffd3596-e32d-4789-a214-ca2b494bbdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Flow 'volume_create_manager' (38f70700-0bdd-4b9d-83fd-a6c892306305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:32 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-85ab9411-891a-40a2-9eaf-f0f97c6b6fd5 tempest-VolumeDependencyTests-579031880 None] Created volume successfully.
Feb 28 01:31:32 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 1073741824" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:32 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:32 devstack sudo[90810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0
Feb 28 01:31:32 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:33 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" returned: 0 in 0.435s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'} {{(pid=82470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6380a183-889a-4dbe-83bd-591352ed963d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0', 'volume_size': 1}' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a97c2f-644d-4198-9cea-b10d70b6e1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 28 01:31:33 devstack cinder-volume[82470]: INFO cinder.volume.flows.manager.create_volume [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Volume volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 (0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0): created successfully
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a97c2f-644d-4198-9cea-b10d70b6e1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82470) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Flow 'volume_create_manager' (418f0615-fe41-4052-9ef7-ae64fbd7a8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82470) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 28 01:31:33 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-8012cf0d-9e1f-4848-a2b3-c98713729c9e tempest-CinderUnicodeTest-7673879 None] Created volume successfully.
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-af822a74-ea11-4411-83bf-bb8b0a579196-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-af822a74-ea11-4411-83bf-bb8b0a579196-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-quobyte-af822a74-ea11-4411-83bf-bb8b0a579196" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-af822a74-ea11-4411-83bf-bb8b0a579196" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6d927c-915b-4241-bab5-47143792d2e2]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:33 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:33 devstack sudo[90813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196
Feb 28 01:31:33 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:34 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196" returned: 0 in 0.571s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:34 devstack sudo[90819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196
Feb 28 01:31:34 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:34 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-af822a74-ea11-4411-83bf-bb8b0a579196" returned: 0 in 0.515s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-af822a74-ea11-4411-83bf-bb8b0a579196" released by "delete_volume" :: held 1.133s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Creating offline snapshot 4a046ee7-7abb-4110-901b-e394ee307196 of volume 0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 {{(pid=82470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[abff533b-dfac-4b0c-b62f-bbd7ae85ffe6]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Created reservations ['f856a2f8-1229-4431-8781-31e9191c08be', 'b49039ba-4fb0-4407-9e00-bfad954d5ee3', '2bb5e95b-d618-4fca-a2a8-ce72dc2b6ef9', '30a6e64b-71ef-48a3-b8f3-d260f1baf098'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:34 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:34 devstack sudo[90822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0
Feb 28 01:31:34 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:34 devstack sudo[90823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:34 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:35 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.426s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:35 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Deleted volume successfully.
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-ff2d0ac9-db6a-4cd8-a18f-99ad2ce4b272 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-af822a74-ea11-4411-83bf-bb8b0a579196-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:35 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" returned: 0 in 0.553s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196 1G {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:35 devstack sudo[90830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196 1G
Feb 28 01:31:35 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-75c297b9-14f2-400c-9e7f-c33667197a13-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-75c297b9-14f2-400c-9e7f-c33667197a13-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-quobyte-75c297b9-14f2-400c-9e7f-c33667197a13" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-75c297b9-14f2-400c-9e7f-c33667197a13" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce53db-1134-43b4-8673-b86b245db6b4]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:35 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196 1G" returned: 0 in 0.524s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:35 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:35 devstack sudo[90836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196
Feb 28 01:31:35 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:35 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13
Feb 28 01:31:35 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:36 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 -F qcow2 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196" returned: 0 in 0.431s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:36 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196 is being set with open permissions: ugo+rw
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:36 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13" returned: 0 in 0.480s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:36 devstack sudo[90845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196
Feb 28 01:31:36 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:36 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13
Feb 28 01:31:36 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:36 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-75c297b9-14f2-400c-9e7f-c33667197a13" returned: 0 in 0.441s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-75c297b9-14f2-400c-9e7f-c33667197a13" released by "delete_volume" :: held 0.951s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:36 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196" returned: 0 in 0.486s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Created reservations ['317751d1-8b40-49d4-9311-ef9ac7bb67a1', 'c148cf4e-ccb9-4c94-931f-dfe7b5cb79e1', '6b95bbcd-314f-4c7c-8495-14a5e3c27cf0', '14d10902-ca7d-4af0-b121-f19f8c804685'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:36 devstack sudo[90852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.info
Feb 28 01:31:36 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:36 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:36 devstack sudo[90854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:36 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:37 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.info" returned: 0 in 0.426s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:37 devstack cinder-volume[82470]: WARNING cinder.volume.drivers.remotefs [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.info is being set with open permissions: ugo+rw
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.info {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:37 devstack sudo[90858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.info
Feb 28 01:31:37 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:37 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.409s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:37 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Deleted volume successfully.
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1610d6f1-c94c-474e-877e-39ec95d37ac6 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-75c297b9-14f2-400c-9e7f-c33667197a13-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:37 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.info" returned: 0 in 0.393s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.894s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:37 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-a0ed4dc2-65df-474b-a474-69f343555f92 tempest-CinderUnicodeTest-7673879 None] Create snapshot completed successfully
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Acquiring lock "cinder-4a046ee7-7abb-4110-901b-e394ee307196-delete_snapshot" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Lock "cinder-4a046ee7-7abb-4110-901b-e394ee307196-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Acquiring lock "cinder-quobyte-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" by "delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Lock "cinder-quobyte-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Acquiring lock "cinder-quobyte-4a046ee7-7abb-4110-901b-e394ee307196" by "_delete_snapshot" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Lock "cinder-quobyte-4a046ee7-7abb-4110-901b-e394ee307196" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Deleting offline snapshot 4a046ee7-7abb-4110-901b-e394ee307196 of volume 0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] snapshot_file for this snap is: volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196 {{(pid=82470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18cac34-32c5-4e8e-9b05-024ddf9c6c27]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-636983c5-f0ec-4210-a85e-568cf266fc6b-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:37 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-636983c5-f0ec-4210-a85e-568cf266fc6b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:38 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "cinder-quobyte-636983c5-f0ec-4210-a85e-568cf266fc6b" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:38 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-636983c5-f0ec-4210-a85e-568cf266fc6b" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6150c8-a57f-4633-a62b-caccc7a2ad8d]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:38 devstack sudo[90863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b
Feb 28 01:31:38 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:38 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196" returned: 0 in 0.490s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.remotefs [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19a42e6-a6af-470a-b651-deabf3362d19]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:38 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0
Feb 28 01:31:38 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:38 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b" returned: 0 in 0.519s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:38 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b
Feb 28 01:31:38 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:38 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" returned: 0 in 0.510s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:38 devstack sudo[90879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196
Feb 28 01:31:38 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:38 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-636983c5-f0ec-4210-a85e-568cf266fc6b" returned: 0 in 0.425s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:38 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-quobyte-636983c5-f0ec-4210-a85e-568cf266fc6b" released by "delete_volume" :: held 0.967s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Created reservations ['985419ff-c940-438f-97c6-ab5701364113', 'd721aa47-7336-4d27-b853-baddada419b1', '2963a8fa-07f0-48c6-8289-e4f67f4981c4', '0f311d85-70c8-41b4-879e-73d8dbf258a9'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:39 devstack sudo[90881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:39 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:39 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196" returned: 0 in 0.471s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:39 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196
Feb 28 01:31:39 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:39 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.468s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:39 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Deleted volume successfully.
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-990382ec-c6bc-4948-bb0f-e2eb4afb4077 tempest-VolumeDependencyTests-579031880 None] Lock "cinder-636983c5-f0ec-4210-a85e-568cf266fc6b-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:39 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0.4a046ee7-7abb-4110-901b-e394ee307196" returned: 0 in 0.471s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Lock "cinder-quobyte-4a046ee7-7abb-4110-901b-e394ee307196" released by "_delete_snapshot" :: held 1.994s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Lock "cinder-quobyte-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" released by "delete_snapshot" :: held 2.015s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Created reservations ['d0ff5931-6dd2-4dc6-980b-45e232c361e0', 'f2d17fdb-8213-4825-98d9-4d31be0b3437', 'c733fa4e-a0ef-4e88-9de6-9b4444835ee3', '82fb501b-2c4b-44a2-9cda-4de8f6f41b3f'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:39 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Delete snapshot completed successfully.
Feb 28 01:31:39 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-bf1a1090-6c15-4b70-8651-e648d2d527cb tempest-CinderUnicodeTest-7673879 None] Lock "cinder-4a046ee7-7abb-4110-901b-e394ee307196-delete_snapshot" released by "delete_snapshot" :: held 2.095s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Acquiring lock "cinder-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Lock "cinder-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Acquiring lock "cinder-quobyte-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Lock "cinder-quobyte-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" acquired by "delete_volume" :: waited 0.007s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5b1786-a3fa-4229-a61b-7724154f4092]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:41 devstack sudo[90931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0
Feb 28 01:31:41 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:41 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" returned: 0 in 0.457s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:41 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0
Feb 28 01:31:41 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:41 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" returned: 0 in 0.397s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Lock "cinder-quobyte-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0" released by "delete_volume" :: held 0.884s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:41 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Created reservations ['0b21c4cb-dc73-43d4-8e1a-27c551d3c90a', '28f8ba56-a72e-47d7-9348-7d4b7c7fc47c', '3818d7f3-ec11-41d1-9927-001fe10fa8a7', '1433cf6c-3e0a-4ac2-a03c-e2b53961218a'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:42 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:42 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Acquiring lock "cinder-90f006b6-bfab-4919-9036-c49be229e53b-delete_volume" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Lock "cinder-90f006b6-bfab-4919-9036-c49be229e53b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Acquiring lock "cinder-quobyte-90f006b6-bfab-4919-9036-c49be229e53b" by "delete_volume" {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Lock "cinder-quobyte-90f006b6-bfab-4919-9036-c49be229e53b" acquired by "delete_volume" :: waited 0.008s {{(pid=82470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b190038-0c0b-441a-90c9-f6394715344a]: (4, 'qcow2') {{(pid=83189) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:42 devstack sudo[90942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b
Feb 28 01:31:42 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:42 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.413s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:42 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Deleted volume successfully.
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-3402d783-dfb9-4f3b-88d7-88e93ecad635 tempest-CinderUnicodeTest-7673879 None] Lock "cinder-0ee9e158-5b5f-412f-8c9e-fe02a8fdaed0-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:42 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b" returned: 0 in 0.461s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:42 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:42 devstack sudo[90948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b
Feb 28 01:31:42 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:43 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343/volume-90f006b6-bfab-4919-9036-c49be229e53b" returned: 0 in 0.402s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Lock "cinder-quobyte-90f006b6-bfab-4919-9036-c49be229e53b" released by "delete_volume" :: held 0.885s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG cinder.quota [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Created reservations ['e9ad328e-e226-488c-bec9-5512aa3451fb', 'bd3847f0-f491-4717-893e-a87451e7407e', '3ef260ef-2a47-4182-ae90-b9344c9d3a6d', '11854d0e-425f-4a97-b10f-a6d5af13d39d'] {{(pid=82470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:43 devstack sudo[90951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:43 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 28 01:31:43 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343" returned: 0 in 0.410s {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG cinder.manager [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Notifying Schedulers of capabilities ... {{(pid=82470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 28 01:31:43 devstack cinder-volume[82470]: INFO cinder.volume.manager [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Deleted volume successfully.
Feb 28 01:31:43 devstack cinder-volume[82470]: DEBUG cinder.coordination [None req-1d25c8a0-a158-4dfb-9ac2-fb69c3968e11 tempest-CinderUnicodeTest-7673879 None] Lock "cinder-90f006b6-bfab-4919-9036-c49be229e53b-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=82470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 28 01:31:53 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=144,cinder:INSERT=53,cinder:UPDATE=232,cinder:DELETE=17 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:31:53 devstack cinder-volume[82470]: DEBUG dbcounter [-] [82470] Writing DB stats cinder:SELECT=172,cinder:INSERT=62,cinder:UPDATE=222,cinder:DELETE=19 {{(pid=82470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 28 01:31:54 devstack cinder-volume[82470]: DEBUG oslo_service.periodic_task [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82470) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 28 01:31:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 28 01:31:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 28 01:31:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc': None} {{(pid=82470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 28 01:31:54 devstack cinder-volume[82470]: DEBUG cinder.volume.drivers.quobyte [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-974d1d0e-55e9-4db1-ac18-464e82f833bc'] {{(pid=82470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 28 01:31:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.lockutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 28 01:31:54 devstack cinder-volume[82470]: DEBUG oslo_concurrency.processutils [None req-cd95eedf-2878-4998-8867-32fa5fda1430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343 {{(pid=82470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 28 01:31:54 devstack sudo[91228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/31110a9e4cde621c0a343ec5bbb55343
Feb 28 01:31:54 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)